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THE SECRETARY 

WASHINGTON, D.C. 20202 



TO THE CONGRESS OF THE UNITED STATES ; 

I am pleased to transmit to Congress "An Evaluation of ESEA Title I 
— Program Operations and Educational Effects." This report to Congress 
is required under Section 183(g) of Title I of the Elementary and Secondary 
Education Act» as amended (P.L. 95-561)» which states: 

"The Secretary shall make a report ... no later than February 1» 
1982» concerning the results of evaluations of programs and projects 
required under this section* which shall be comprehensive and 
detailed* as up-to-date as possible* and based to the maximum extent 
possible on objective measurements* together with other related 
findings and evaluations and ... recommendattons with respect to 
legislation." 

Some of the information in this report has already been presented 
to Congress in the Department of Education's 1981 Annual Evaluation 
Report . That report and earlier reports or testimoriy to congress 
(Including the National Institute of Education's Survey of Compensatory 
Education and earlier reports on the evaluation of Title I) concentrated 
particularly on program operations* including the distribution of funds 
and the characteristics of Title I participants. 

The major purpose of this document is to provide Information* in 
greater detail than has previously been available* to the Congress 
concerning the patterns of services provided in Title I programs and 
the educational Impacts of such services* and to provide a single 
document that summarizes the results of Title I studies to date. 
Secondarily, a description is provided of efforts undertaken by the 
Department of Education (ED)* in coordination with State education 
agencies and local school districts* to improve the ways in which 
instructional and evaluative activities are Implemented across the 
country. 

This report Includes* for the first time* comprehensive information 
obtained from several sources: information provided to ED by all State 
educational agencies (based on district evaluation reports) on participation* 
staffing, instructional treatment and educationat impact of the Title I 
program in the 1979-8D school year; and information obtained through 
nationally representative studies* including longitudinal studies of 
compensatory education conducted between 1975 and 1981 and results from 
the National Assessment of Educational Progress which summarUe national 
trends from 1970-1980. 

Title I has* in a sense* already been reauthorized and substantially 
amended by the passage of Title V (the Education Consolidation and 
Improvement Act of 1981 , or ECIA) of the omnibus budget Reconciliation 
Act of Iggn Chapter 1 of that title "Financial Assistance to SeeT" 
Special Educational Needs of Disadvantaged Children" is scheduled to 
take effect on October 1* 1982. Changes In the 90als and program 



requlrenents to Title I of ESEA that Mill occur Mhen Chapter X Is 
Implemented are briefly discussed throughout this report. However* we 
will not In this report offer any explicit recomiendatlons for legislative 
consideration other than those Implied by the findings. 

The report Is organized Into five chapters » the first of which Is a 
brief **execut1ve summary" describing the major highlights and findings 
provided In the report. Subsequent chapters provide more detailed Infor- 
mation on Title I program objectives and operatlwts; on the nature and 
Implementation of compensatory educational programs; on the educational 
Impacts of such services on student achievement; and on national trends 
towards Improving and using evaluations* as evidenced by case studies 
of State and local district activities. 

We hope you find this report useful as you continue the difficult 
task of re-examining and revising the Federal role as It pertains to 
assistance and guidance for elementary and secondary education programs. 




T. H. Sell 
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CHAPTER I 
HAJOR FINDINGS AND HIGHLIGHTS 

Chapter I contains a simmary of the major findings of each of the 
sections of this report to Congress* Additional detail oii each of the 
summary points can be found In the respective chapters of this report. 

Chapter II Highlights; Prograw Objectives dnd Operations 

Chapter II describes the size and scope of Title I programs and 
reviews the objectives of Title I* In addition^ the operation of Title I 
programs Is discussed* Including the Identification of eligible schools* 
the selection of students* and the participation of parents and other 
Important groups In decision-making* The major provisions of Chapter 1 
of ECIA are discussed and compared to Title K The principal findings 
Include the following: 

0 Title I Is the largest Federal aid program In elementary and 
secondary education* with appropriations growing from $959 
million In FY 1966 to over $3 billion In 1980* 

0 About 87t of all school districts received Title I funds In the 
1979 fiscal year* and about half (7*000) received Concentration 
Grants* 80% of which were awarded for programs in urban areas* 

0 While approximately 13t of the local education agencies receive 
no Title I funds* In the poorest districts Title I can account 
for up to 16% of a district's total educational funding* 

0 Ten States California* New York* Texas* Ohio* Pennsylvania* 
ininols* Puerto Rico* Michigan* Florida* and New Jersey receive 
over 50% of the Title I monies available* 

Chapter III Highlights; The Nature and Implementation of Compensatory 

Education Programs ' 

Chapter III provides a description of Title I projects as they are 
currently carried out by local education agencies* Infortiiation Is 
provided on the characteristics of students served* the staffing 
patterns of Title I projects* the types of services provided* and 
on summer school projects* 

Characteristics of Students Served 

0 Approximate!/ 5*4 million students were served by Title I 
projects during the 1979*80 school year* 

0 Approximately ll*6t of the nation's elementary and secondary 
school stcJents in public schools participated In Title I 
in 1979-80. This varied by State from 4t to zeX of the public 
school students* 

0 Approximai^ely 3*7t of nonpublic school students were served by 
Title I 1n 1979-80* 
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Approximately 72t of the public school Title I students and 76K 
of the nonpublic school Title I students were In grades 1 to 6. 

Slightly more than one-half of the Title I participants were 
Mh1te> about one-quarter were Black* about 15t were Hispanic* 
and the remainder were Asian, Pacific Islander, or American Indian. 

The typfcal Title I readfng student was at the 22nd percentile In 
reading achievement when tha program began. This varied by 
grade from a high of the 28th percentile In grade 2 to a low 
of the 12th percentile in grade 12. Large variations also were 
found across the States. 

The typical Title I mathematics student was at approximately the 
24th percentile In mathematics achievemen' at the beginning of 
the program. This varied by grade from a high of the 35th 
percentile at grade 2 to a low of the 21st percentile In grade 10. 
Again, large var^'atlon was found across the States. 

Title I Staffing 

0 Over 200,000 full-time equivalent staff members were employed 
on local Title I projects during the regular school term of 
1979-80. 

0 Approximately 39% of the staff members were teachers and 46t 
were teacher aides. Only 3t of the staff members were classified 
as administrative staff. 

Types of Services Provided 

During the regular term of 1979-80: 

0 Approximately 4.2 million students {78X1 received services In 
reading; approximately 2.5 million (46%) did in math. 

0 Large numbers of students also were served In language arts 
(19%), health and nutrition services ^28%), and other Instruc- 
tional areas (1931)* Fewer students were served by non-instructional 
programs, such as programs In attendance, social work, guidance, 
and psychology (15%); pupil transportation (3%); English to 
limited English speaking students (7t), and other supporting 
services (8%). Only 9,084 students received special services 
for the handicapped, and 5,571 received vocational services. 

0 Students were more likely to be served In pull-out projects 
than in dny other setting. Language arts projects are more 
likely to be in the regular class than are mathematics and 
reading projects, but even In language arts less than one-half 
of the students are served In the regular class. 

0 Title I students tend to be S(irved in small groups. Approxi- 
mately 75% - 90t of the elementary school studtnts In grades 
2 and 6 are served In r:ettings where the student to teacher 
ratio is 10:1 or less. 
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Sutnmer Term Activities 

During the summer term of 1979*80: 

0 Over 300,000 students were served by Title I projects* mostly 
in reading (66%) and mathematics (^%)« 

0 Over 31»000 fuH-tlme equivalent staff members were einptoyed» 
the majority of whom were Title I teachers (S9%) or teacher 
aides (25%). 

Chapter IV Hightights: Student Achievemert 

Chapter IV contains Information on the achievement of students In 
Title I programs^ including information on short-term achievement 
impact^ information on achievement over three years both for students 
who continued in Title I and for Title I "graduates*" and information 
on factors related to school year achievement* 

A comparison of compensatory education students in grades 1 to 6 
with a similar group of students who did not receive compensatory 
education showed that: 

0 Compensatory education students gain more than similar 
students who do not receive services In grades 1» 2» and 3 
in reading and in grades 1 to 6 In mathematics* 

0 The positive effects of compensatory education are true 
particularly for Title I students* though these benefits of 
compensatory education are not great enough for the participants 
to "catch up*" with non-dlsadvantaged non-compensatory students* 

Information collected over three years showed that: 

0 In reading* students who have left the Title I program because 
of high performnce do not fall back noticeably after th^ 
cease participation in Title I# 

0 In mathematics* students who have left the program because of 
high performance tend to show a decline after participation ceases 

A study of the relationships between types of services and the 
effects of comiiensatory education showed that: 

0 The auwunt of regular instruction and tutor/Independent work 
has positive* but modest* effects on achievement growth* 

0 The amount of instruction by special teachers* by aides or 
assistants* or In very smfill groups (le?.s than 7 students) does 
not often have detectable effects* and when it does* those 
effects are negative* In almost all cases* however* these 
relationships between Instructional factors and achievement 
growth are weak* 
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0 Students taught by mre experienced teachers tend to attain 
greater growth In reading and mathematics achievement* It 
was consistently found that the teaching experience of the 
regular staff was positively related to achievement* 

Chapter V Highlights: Implementing and Using Evaluations at the 
State and Local Level 

Chapter V provides a review of the evaluation requirements and goals 
of Title I and a summary of ED's efforts to implement the evaluation 
requirements* In addition* a set of case studies developed to provide 
a national overview in areas of evaluation and program Improvement 
is provided* 

0 The Title I Evaluation and Reporting System was required for 
the first time in the 1979-80 school year* All States sub- 
mitted Title I participation and achievement information 
using the system* so that for the first time comparable data 
were received from all of the States* 

0 The Title I Technical Assistance Centers expanded from their 
early role of providing assistance on the Title I models and 
reporting requirements to providing assistance on a wider 
range of topics related to Title I evaluation that were 
requested by State and local Title I staff* Areas of 
assistance included data quality control » evaluation of early 
childhood education projects* process evaluation* and use of 
evaluation for program improvement* 

0 During the 23 ror iths from November 1979 through September 1981» 
the Technical Assistance Centers provided over 5600 workshops 
and consultations to nearly 82*000 clients* 

0 Title I staff in numerous States and districts are utilizing 
Title I evaluation procedures that go beyond the requirements 
of the Title I Evaluation and Reporting System* Often* the 
focus of these activities is to examine program implementation* 

0 Maryy States have successfully implemented extensive quality 
control procedures for reviewing* editing* and correcting 
evaluation information submitted by local school districts* 
Maryy States have also begun providing descriptive information 
and information on achievement gains back to participating 
school districts and are providing districts with information 
on how their evaluation procedures can be strengthened* 

0 There is a nationwide focus on identifying and sharing informa- 
tion about exemplary programs* 
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PROGRAM OBJeCTIVES AND OPERATION^ 

Title I of the Elementary and Secondary Education Act was enacted 
)n 1965 'to provide financial assistance... to expand and Improve... 
educational programs,. .which contribute particularly to meeting the spe- 
cial needs of educationally deprived children" (ESEA Title I, Section 
101. P.L. 89-10, as amended by p.L. 95-561). Since then, all State 
Educational Agencies (Including the District of Columbia, Puerto Rico, 
the Bureau of Indian Affairs and the various insular Territories) and 
approximately 14,000 local education agencies (LEAs) have provided 
services funded under Title I. By far. Title I Is the largest Federal 
aid program In elementary and secondary education, with appropriations 
growing from $959 million In FY 1966 to over $3 billion In 1980 (See 
Table II-l). 

Table II-l 
Funding History of ESEA Title I 
Year: Aut^^^^^zat^^on:l" Appropriation 

1966 $ 1,1S2,981,206 $ 959,000,000 

1967 1,430,763,947 1,053,410,000 
1963 1 ,902,136,223 1 ,191 ,000,000 

1969 2,184,436,274 1,123,127,000 

1970 2,523,127,905 1,339,050,900 

1971 3,457,407,924 1,500,000,000 

1972 4,138,377,672 1,597,500,000 

1973 4,927,272,941 1,810,000,000 

1974 4,182,509,627 1,719,500,000 

1975 2 7,954,872,444 3,776,000,000 

1976 (FY77) 4,692,51 1 ,963 2,050,000,000 

1977 (FY78) 4,660,666,596 2,285,000,000 

1978 (FY79) 5,075,334,514 2.735,000,000 

1979 (FY80) 5,680,447,238 3,228,382,000 

1980 FY81) 6,291,969,913 3,215,343,000 

1981 (FY82) 7,047,423,325 3,104,317»000 

1982 (FY83) 3,480»000,0003 2,886,000,000'* 



' The authorization and appropriation levels shown In these columns 
pertain to the entire Title I program, and include grants to LEAs 
(Part A programs), concentration grants and State administered (Part B) 
programs, viz, the Migrant Education Program and the Program for Neg- 
lected and Delinquent Children. The authorizations and appropriations 
for Part A programs are shown In Table II-2, while funding for Part B 
programs can be found in the 1981 Annual Evaluation Report , 

2 Commencing in 1976, the program became advance-funded from the prior 
year's appropriation. This resulted in a doubllng-up of funding In 1975. 

3 Budget authority established for ESEA Title I, under Section 513(a) of 
the Omnibus Budget Reconciliation Act of 1981 . 

4 Level of the 1982 continuing resolution. 
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PROGRAH GOALS AND OBJECTIVES 

Section tOl of Public Law 89-t0» 'The Elementary and Secondary 
Education Act as amended in 1978 by Public Law 95-56U states: 

"In recognition of the specific educational needs of children 
of low-income families and the Impact that concentrations of 
low-income families have on the ability of local educational 
agencies to support adequate eaiicationat programs, the Congress 
hereby declares it to be tht policy of the United States to 
provide financial assistance ### to local educational agencies 
tervinq areas with concentrations of children from low-income 
families to expand and improve their educational programs by 
various means {including preschool programs) which contribute 
particularly to meeting the special educational needs of edu- 
cationally deprived children/' 

Section 124» which states the requirements of local district programs* 
specifies under subsection (a) "Purpose of Program" that a district may 
use Title I funds only for programs "designed to meet the special edu- 
cational needs of children and must include in its project evaluation 
"objective measurements of educational achievement" (subsection (g))# 
Additional emphasis is given to educational goals and instructional 
services to meet those goals in Section 124 (f)(2)» which prohibits 
the use of Title I funds for healthy sociaU or nutrition services 
unless the district has requested help from the State in locating 
and using other sources of funds for those services and has been 
unable to find any# Implementing these legislative provisions are 
regulations requiring the development of educational objectives and 
instructional strategies to achieve those objectives (Section 201*105» 
Federal Register ^ Volume 46» No* 1Z» January 19» 1981» P* 5173)* 



PART A — PROGRAMS OPERATED 8Y LOCAL EDUCATIONAL AGENCIES 

The operations of Title I are clearly specified in the law and 
accompanying regulations* and are described below in terms of eight 
major activities: (1) the allocation of funds to districts* (2) the 
identification of eligible schooU* (3) the selection of eligible 
students* (4) the provision of services to them to meet their needs* 
(5) the documentation that Title I services do not replace those they 
are already entitled to (from district* State* or other Federal pro- 
grams)* (6) inclusion of important groups such as parents in decision- 
making* (7) evaluation of the efforts* and (8) State and local dist^^ict 
administration of the program components described above* Each of 
these eight major activities is described in terms of the legislation 
and the scope of such activities as they occur in the current imple- 
mentation of Title U 

In addition* changes to these sections made in the Education 
Consolidation and Improvement Act of 1981 (ECIA) are presented* ^A 
discussion of how well State and local education agencies have 
achieved the objectives of each activity area is provided where 
appropriate* though issues related to the nature of Title I services 
or recipients are treated specifically in Chapter III of this report* 
and issues pertaining to the educational Impact of services are 
Q discussed in Chapter IV* 
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The AllQcation of Title I Funds 

There are two types of grants to districts: Basic and Concentration*5 
As miqht be expected given the purpose of this program to assist 
local agencies with concentrations of students from poverty backgrounds 
{see above)» the allocation of funds for B_a_ s ic Grants to districts is 
based on a formula which incorporates^ as one of its elements » counts 
of children frexn poor families living within their boundaries. The 
other eleinent is the State's average per-pupil expenditure (or 80% or 
120% of the Nation^s average per-pupil expenditure if a State's 
average falls outside this range). 

Specifically^ a district is authorized under Section 111 of Title I 
to receiv'e a grant equal to: 

40% times the number of students times the State '$ average 

aged 5-17 from fami 1 ies per-pupil expendi* " 

in poverty living fn ture [or 80% or 

the district plus 120% of thrHation^s 

the number of students average per-pupil 

from iocal institutions figure^ as noted ' 

for the neglected » or above ) 

delinquent^ or in (Section 111(a)(2)(A)) 
foster homes (Section 111(c)) 

A family is defined as "in poverty'* for the purpose of the above 
counts if its income meets either of two conditions: (1) the income 
falls below the criterion of poverty used by the Bureau of the Census 
(Section lll(c)(2)(A))» or (2) the income exceeds that criterion due 
to the receipt of payments under the Aid to Families with Dependent 
Children program (Section 111(c) (2) (B) )*6 

Census data are crucial to the workings of the formula* and the 
law contains several provisions to overcome problems caused whenever 
Census data are used. For example* in cases where Census data describe 
a geographical unit other than school districts (usually counties)* the 
grant is computed by ED for those other units* and the State is responsible 
for distributing the funds to districts (often called "subcounty 
allocations") (Section 111 (a)(2)(8)). Also* since Census data are collected 
infrequently* there are provisions for computing district allocations 
on more recent aata if the district^ population has changed drastically 
(Section 111(a)(3)(D))*? 



^ A third category of grants* Incentive Grants* has remained unfunded. 

^ Section lll(c)(l)(8) provides* however* that grants for FY 1979 could 
count only 2/3 of those children whose families met this second 
condition* making the formula for grants that year the same as 
before the Education Amendments of 1978* 

^ An additional funding complication requires that 1/2 the funds in 
excess of the national FY 1979 appropriation te distributed to States 
and districts on the basis of the number of children in families 
below 50% of the national median income for a family of four 
(according to the 1975 Survey of Income and Education)* The 
remaining half of the excess over the FY 1979 level is distributed 
according to the formula described above* 
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The formula and provisions for collecting the various possible 
data are used to detertiilne the size of the grant a district Is entitled 
to receive* Mhen appropriations for the Title I program as ^ whole 
are Insufficient to fund all the grants as computedt however* the 
Part B programs to State agencies {for migrant* neglected/delinquent* 
and handicapped programs) are funded first* since their set-asides are 
comptJt(Hl before the remainder of avalUble funds Is distributed under 
Part A {In proportion to each d1str1ct*s entitlement)* Section 193(a) 
provides* however* that no district shall receive* due to this ^'ratable 
reduction*" a grant which is less than 85% of the one It received the 
previous year* 

Section 117 provides for a second cype of grant* the Concentration 
G ra nt* The purpose of such a grant is "to provide more effective 
programs of Instruction* especially in the basic skills of reading* 
writing, and mathematics* to meet the special educational needs of 
educationally deprived children" In districts whose counties have 
especially high concentrations of children from families in poverty 
(Section 117(a))* To qualify* a district's county must have 5*000 or 
more students counted for the purpose of determining the size of its 
Basic Grant (Section 111(c)) or have 20% or more of its students be 
those so counted* The size of a district's or county's Concentration 
Qrant is the same proportion of the national total appr(H>r1ated for 
Concentration Grants that year as the area's Basic Grant is to the 
national, total of Basic Grants* The Concentration Grant is viewed as 
a supplement to the Basic Grant, to be used as described in the dis* 
trict's project application approved by the State* 

A third type of grant to districts is the Incentive Grant author- 
ized in Section 116 of Title I* A distr1ct*s eligibility for an 
Incentive Grant depcMs on whether its ' ^te has a compensatory educa- 
tion program which (1) serves only educationally deprived children* 
(2) has perfortiiance objectives related to educational achievement and 
evaluates projects acccording to them* (3) provides supplementary 
services to meet special educational needs of participants, (4) keeps 
and makes available necessary records* (5) is closely monitored* and 
(6) distributes at least 50% of its funds within a district to schools 
serving high concentra*1ons of students from poor families (Section 
116(a)(2))* However* Incentive Grants have remained unfunded through 
1982* 

As noted above* the purpose of Title I is to provide funds for 
extra services to educationally disadvantaged students in districts 
with areas of high poverty* The formula uses estimates of the aiitount 
of poverty In the area (counts of children from poor families) and 
average educational expenditures to determine the size of district 
grants* One rough way to assess the ade'^uacy of the formula for allo- 
cating funds to districts in poor areas is to note the correspondence 
between the numbers of children counted as being from impoverished 
backgrounds and the amount of funds received* 
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The Department of Education's 1980 Annual Evaluation Report described 
the relationship between the numbers of formula-eligible children and 
per-pupi1 expenditures* It was shown that the Souths with 45*5% of 
the formula-eligible children^ received 39.9% of the allocated Title I 
funds* In contrast, the Northeast received 22*9t of the allocated 
Title I funds although only having 18.8% of the Nation's formula- 
eligible children. Ihe reason for this difference is primarily due 
to differential regional costs of education. Host Northeastern States 
receive over $200.00 (in FY 77) for each formula-eligible child as a 
result of high State per-pupil -expenditures in these States. In con- 
trast, over one half of the States in the South received the inlmum 
sum of $163.00 (80% of the national average) per formula-eligible 
child as a result of their lower funding in eiducation. 

The correspondence between numbers of students from poor back- 
grounds and receipt of funds is high. Ihe National Institute of Edu- 
cation (NIE) found, specifically* that: (1) as the number of formuU- 
ellgible children in a county increases, the average Title I allocation 
to the county rises consistently, and (3) district allocations reveal 
patterns similar to those observed at the county level (NIE, Survey of 
Compensatory Education* M77). Additional information on school poverty 
and Title I participatio/i is provided in Chapter III of this report. 

Chapter I of the "Education Consolidation and Inqircvement Act" 
generally maintains the same basic provisions for funds allocation as ESEA, 
Title I. However, some modifications to the funding levels of State- 
administered Part B programs have been enacted which limit the funding 
of such programs to 14.6 percent of the total appropriation (Section 
513(a) of the Omnibus Budget Reconciliation Act of 1981 ) for 1982. 

To summarize, a district's Basic Title I grant (and its Concentra- 
tion Grant if that subprogram has been funded that year) is based on 
Its numbers of students from families in poverty and the per-pupil 
expenditures for its State. Ihe law also contains several provisions 
for updating the counts or adjusting for drastic shifts in population. 
(Section 111(a)). More information is provided in Chapter III of this 
report concerning the relationship between poverty levels and achievement 
levels of participating schools and students. 

Title I funds continue to represent about 3% of the total national 
expenditure for public elementary and secondary education. Table II-2 
depicts the funding of Part A» Regular grants to local districts, over 
the thtrteen-year period from 1970-1982. ^own there are the authorized 
level > the actual appropriations, and those appropriations adjusted 
for Inflation with 1970 as the base year. The increase in authoriza- 
tions (up until l?tJi) was 160t while appropriations (including 1982) 
increased 112t; however* "constant dollar" appropriations decreased 
about 22%. 
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Table n-2 

Annual Funds for ESEA Title I, Part A Regular Grants 
(In Millions of Dollars) 





Authorized 


Actual 


Adjusted 


Year 


Level 


Appropriations 


Appropriations 


1970 


2.392 
2,869 


1 .219 


1*219 


1971 


1.340 


1*274 






1 .4U/ 




1973 


4.187 


1.536 


1.355 
1,172 


1974 


3.408 


1.446 


19/5 


7.448 


3.212 


2.341 


1976 


4.375 
4.317 


1.721 


1,172 


1977 


1.926 


1,239 


1978 


4.685 


2.356 


1.420 


1979 


5,211 


2.630 


1,389 


1980 


5.778 
6.334 


2.633 


1,237 8 


19B1 


2.513 


955 


1982 


n.a. 


2.413^ 


922 



Funding for the two other types of Part A grants: Concentration 
Grants and Incentive Grants, has been smaller of course Table II-3 
shows those figures. As ECIA is scheduled to begin Implementation on 
Oct(rt)er 1, 1982, both types of grants remain unfunded. 

Table II-3 



Funds for Part A, Special Grants 
(In Millions of Dollars) 



Budget Year 


Concentration Grants 


Incentive Grants 


1979 (FY 80) 


147 


0 


1980 (FY 81) 


98 


0 


1981 (FY 82) 


99 


0 


1982 (FY 83) 


0 


0 



Information from 1976 (NIE* 1976) is conipareci with more recent data 
(AdTech* 1982) In Table U-4 to portray the breakdown of costs for a typical* 
large Title I project: 



3 Assuming lit Inflation In 1979* lot inflation in 1980 and 10% In 1981. 
5 Froffl 1982 contlnuinq resolution 
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Table 11-4 



Averatie Allocations of Expenditures for Title I Projects 



Budget Items 


1976 
Percent 
of Cost 


1981 
"Percent 
of Cost 


Instruction 


78 % 


81 % 


Auxiliary services 
(e.g» parent training* 


3 


3 


Administrative costs 
(Inci . evaluation) 


6 


6 


Operations » malnten^tnce 


2 


2 


Fixed charges (e.g. 
personnel benefits* etc.) 


10 


8 


Capital outlays 


1 


0.5 



To Summarize* all 50 States, the District of Columbia* Puerto Rico, 
and all outlying Territories (e.g.» American Samoa* Guam* Trust Terri- 
tories of the Pacific, the Virgin islands, and the Northern Marianas) 
and the Bureau of Indian Affairs receive Title I funds. The size of 
Title I grants, and the portion of district funding that Title 1 repre- 
sents varies considerably. Some highlights concerning the size and 
scope of Title I grants follow: 

0 About 87% of all school districts received Title I funds for the 
1979 fiscal year, and about half (7,000) received Concentration 
Grants, 80% of which were awarded for programs in urban areas. 

0 Most grants {62%) are between $10,000 and $100,000, but 25% of 
them are $100,000 or more (accounting for 84% of the funds). 

0 While aoproximatdly 13% of the LEAs receive no Title I support 
at all. In the poorest districts Title I can account for up to 
16t of a district's educational funding. 

0 Nine "urban" States (having both high proportions of enrollment 
and of enrollment in districts with more than 25,000 students) 
receive grants that account for about 50% of the total Title I 
monies available. These States are California, NeM York, Texas, 
Ohio, Pennsylvania, Illinois, Michigan, Florida and New Jersey. 



Some Territories have elected to receive consolidated grants (e«g. 
American Samoa and the Virgin Islands). In these cases, while Title I 
funds are included In the consolidated grants, each Territory can 
select, from a limited list, which program requirements to follow 
v^en submitting their consolidated grant application. To date. 
Title I has not been selected by any consolidated grant applicant. 
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The Identification of Eligible Schools 



Once a district receives its Title I allocation it must rank its 
attendance areas on the basis of the concentration:^ of children, aged 
5 to 17» in those areas who are from low-income families. In making 
this determination* a district can use any or all of a number of measures 
(Census counts* AFDC» free lunch» hous1nq» health* etc.) if approved by 
the State. 

There are several alternative ways to do these rankings. One can 
simply order the areas* or use variations: apply the 25 percent rule* 
meaning that any school with 25% or more of Its students from poverty 
backgrounds can be designated a Title I school as long as certain 
funding constraints are met (Section 122(a)(1)); serve previously eli- 
gible attendance areas (Section 122(c)); use eligibility by actual 
enrollment (Section 122(b)); or* serve lower ranked areas having a 
greater incidence of educational deprivation (Section 122(a)(2)(A)). 

Two recent surveys have found that districts have Title I programs 
in 90-95% of their eligible elementary schools (NIE* 1976; Wang* et al* 
1978). Of just over 62*500 public schools having any of grades l":^Tn 
1976-77* about 68% received Title I fuiids (27% only Title I plus 41% 
Title I and sofne other compensatory program funds); 14% received only 
other compensatory funds* 18% received none {Hoepfner* et al.* 1977). 
A survey o' 213 Title I districts in 1976-77 found that moTf often (in 
73% of the districts) they used data on the number of children receiving 
free or reduced-price lunches for each of their schools to rank them 
for the purpose of determining Title I eligibility. Second in freguency 
(in 57% of the districts) was the use of AFDC counts; third was census 
data on family income (42% of the districts) (Hemenway* et al.* 1978). 
{Oetails concerning characteristics of schools receivingH'iTTe I funds 
are provided in Chapter III of this report.) 

Chapter I of the "Education Consolidation and Inprovement Act*' 
contains revised procedures for identifying eligible attendance areas. 
School districts will be eligible to receive funds if they provide assur* 
ances in their grant applications to the State agency that projects 
are conducted in "attendance areas ... having the highest concentrations 
of low-^inconte children or are located in all attendance areas of an 
agency which has a uniformly high concentration of such children, 
{Section 556(b)(1)(A) and (B)) or are designed to utilize part of available 
funds for services which promise to provide significant help for all 
such children served by an agency (Section 556(b)(1)(C)). 



Selection of Students to Participate in Title I 

An assessment must be made of the special educational needs of 
children residing in eligible attendance areas (called a needs assess 
ment) to; (1) identify the educationally deprived children* (2] iden- 
tify the general instructional areas for the program to focus on, and 
(3) diagnose the specific needs of children (Section 124(b)). 
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Once the eligible attendance areas and general Instructional areas 
of emphasis have been identified* the district must select as participants 
those students who show the greatest need for those services {Section lZ3{a)). 
In general this means serving the educationally neediest students* 
but there are also provisions for continuation of services to education- 
ally deprived children no longer in greatest need {Section lZ3{b)); 
continuation of services to educationally deprived children transferred 
to ineligible areas In the same school year (Section lZ3(c)); skipping 
children In greatest need who are receiving services of the sa^ne nature 
and scope from non-Federal sources {Section lZ3{d)); and serving all 
students (in a schoolwlde project) if the school has 75% or more of Its 
students from families In poverty and contributes funds from Its own 
sources to the special compensatory program {Section 133)* 

As noted above* ECIA maintains the Importance of serving educationally 
needy children* but only "permits** and may not require that only the 
neediest children be selected for services {Section 556{b)(Z))* ECIA 
also allows for programs which will In part serve all low-income children 
in a district (Section 556(b)(1)(C)). 

An annual assessment of educational needs which Identifies educa* 
tlonally deprived children* permits selection of those with the greatest 
needs and determines the needs of participating children Is still 
required in ECIA (Section 556(b){Z))* 

A detailed discussion of the types of children typically served In 
Title I programs* especially as regards their educational vs* economic 
disadvantagdment* Is presented In Chapter III of this report* 

Providing Services to Meet Special Educational Weeds of Participants 

As noted above* Title I services are primarily Instructional In 
nature* Health* social* or nutritional services can be provided if the 
district has requested State help In finding other ways to support them 
but has been unable to locate such other sources of funding [Section 
lZ4{f){Z))* The services must be of sufficient scope to show promise of 
remediating student needs {Section lZ4(d))* be coordinated with services 
from other sources (Section lZ4{f))« show consideration for evaluating and 
sustaining student gains (Sections lZ4(g) and (tc)), and whenever possible* 
be guided by a plan developed for each student (Section 1Z9)* Services 
must be available to students In public and non-public schools of the 
attendance areas identified as eligible (Section 130)* 

The requirements of sufficient size and scope* evaluations exam- 
ining s.4Sta1ned qains* and availability of services for non-^publlc school 
students are maintained In ECIA (Sections 556{b){3)-(5))* 

Detailed information on the nature and frequency of services pro* 
vided in Title I Is presented In Chapter III of this report* 
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Documentation by the District that Title I Services Oo Hot 
Replace Those to Which Students Are Already Entitled 

The presence of Title I funds in a district should not diminish 
the services available to students from other sources of funds. 
Specifically, the amount of resources devoted per-pupn» or in the 
d9<)regate, to education In the local agency must equal or exceed 
those expended the year before (maintenance of effort (Section 126(a)). 
If for some unforeseen reason this cannot be the case, the district 
can get a i^raiver from the requirement, but only for one year. 

furthermore. Title I funds can be used only for services which 
exceed the average per-^pupil expenditure in a district (excess costs 
Section 126(b)). Similarly, services supported by State and local 
funds In Title I schools cannot differ from the amount supported on 
the average In non-Title I schools by more than 5% {comparability of 
services (Section 126(e)). 

For educationally deprived students, the Title I services must 
be extra to those provided from non-Federal sources ("supplenent, 
rot supplant" (Section 126(c)). In some Sj. ial Instances, costs 
and services for State and local compensatory programs or for 
programs being phased in to restructure education in a district to 
meet needs of educationally deprived students may be excluded 
from the various computations (Sections 126(d) and 131). Sites 
offering school-wide projects need not conq)ly with all the fiscal 
requirements as lonq as certain other conditions are met (Section 
133(c)(2)(A)). 

To summarize. Title I has four fiscal requirements to ensure 
that Title I students get their "fair share** of services from their 
districts: (a) comparabil ity of services (district and State-funded 
services in each Title i school must be comparable to the average 
provided in a district's non-Title I schools); (b) maintenance of 
effort (local and State funding in a district cannot decrease from 
one year to the next); (c) excess costs (Title I funds can be used 
only for costs of Title I projects which exceed the distr1ct*s per- 
pupil expenditure); and (d) Title I funds must supplement, not sup - 
plia nt, other funds for services to Title I students. 

The first two of these fiscal requirements have been examined 
in recent studies. The findings of these studies, as well as a 
brief look at the revisions of ECIA Chapter 1 on all four of the 
fiscal provisions, follow: 

Comparability 

Some members of Congress heard testimony during the 1978 Title I 
reauthorization hearings that the current comparability requirements 
are burdensome and overly rigid, and that they unintentionally detract 
from the effectiveness of Title I services. As a result, the Educa- 
tion Amendments of 1978 authorized (in P.L. 95-561, section 102) a 
study 1n which a limited number of districts were to formulate and use 
alternative comparability criteria, which would provide greater flexi- 
bility without compromising the purpose of the comparability provision. 
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The study» "Utilization and Effects of Alternative Measures of Compar- 
ability/ has been completed* A report of its findings was delivered 
to Congress* as nandated* by September 30, 1981* 

The study was designed to address five questions: (1) what are 
the coinparative administrative* reporting* monitoring* auditing and 
enforcement burdens created by the existing provisionsi (2) to what 
extent do the comparability provisions and alternatives conflict with 
local* State or Federal policies^ (3) to what extent do the provisions 
ensure that districts provide equal local and State resources to 
Title I and non^Title I schools alike^ (4) to what extent do district 
and State processes account for variability in the above three areasj 
and (5) to what extent are the administrative burden* policy conflicts 
and allocations of equivalent resources Influenced by contextual fac* 
tors of districts (e^g* enrollment size* staff* etc*)* 

A sample of approximately 500 school districts was selected from 

23 States* The 500 were telephoned to determine their interest in 
participating In the study and of the 405 for which responses are 
available: 

0 27 reported administrative burden 

0 94 reported conflict with State/local resource allocation 
policies 

0 18 reported both administrative burden and conflict with State/ 
local ri^source allocation policies 

0 266 reported no problem with comparability* 

Of the 44 districts volunteering and participating in the study* 
34 were granted waivers to implement alternatives and 10 were not* but 
were to report under existing provisions* Of the 34 waiver districts* 

24 implemented an alternative as proposed or with minor changes and 
reported under their alternative to their SEAs* Three districts implemented 
their alternative but chose to report under the existing provisions to 
their SEAs* Seven districts did not implement their alternative and 
chose instead to comply with the existing comparability provision* 

The major findings of the study follow: 

0 Little evidence was found that the existing comparability provi* 
sion results in excessive administrative burden* Ninety-five 
percent of the study*s 44 districts Identified one or more 
comparability-^related task as burdensonte* However* over 50% 
reported spending less than 10 staff days per school-year on 
comparability and 23% reported spending 10 to 30 staff days 
per school-year on comparability* Host of the burden reported 
by districts is associated with data co*lection because often 
data are not available in a format required for comparability* 
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0 Seventy*f1ve percent of the 44 districts perceived comparability 
requirements to conflict with State or local resource allocation 
policies. However, only one of these districts was able to pro- 
vide a concrete example of how it was prevented from carrying 
out local policies for allocating staff, proqrams, and services. 
All other districts repeated that they did carry out local poli- 
cies for allocating staff, programs af>d services. The one con- 
flict described was the reallocation of staff to comply with 
comparability after the school year began* Except for eight 
districts^ reallocations involved fewer than three staff members, 

0 Alternative comparability provisions were shown to have little 
uniform impact on administrative burden* Some changes examined 
had the potential to eliminate tasks many districts consider 
to be burdensome. However, changes could increase burden for 
some other districts (e,g., collecting data on expenditures 
for instructional services per pupil for districts that do not 
now collect such data), 

0 Since most implemented alternatives were designed to reduce 
administrative burden^ they had little impact on conflict, 

0 No evidence was found to support changing the existing compara- 
bility provision. However^ it was found that if SEAs are given 
greater discretion in administering comparability (e,g.» by 
permitting districts to use alternative criteria, on a case-by- 
case basis)» many districts could benefit. 

While these study findings have been made somew^^at moot by the 
passage of the "Education Consolidation and Improvement Act of 1981^** 
they can serve as valuable evidence in later debates on the merits of 
the new provision as opposed to merits of the provision as of ig78-80. 
The intent of the comparability requirements has been maintained ir^ 
the new Act (i,e,, to equalize resources in project and nonproject 
areas). Under th*> ECIA, however^ a district can satisfy the 
comparability requirement- by filing a written assurance with the SEA 
that it has established: a districtwide salary schedule; a policy 
to ensure equivalence among schools in teachers^ administrators and 
auxiliary personnel; and, a policy to ensure equivalence among schools 
in the provision of curriculum materials and Instructional supplies. 

Maintenance of Effort 

Section 417(a) of the General Education Provision Act (as amended 
by Section 126 of the Education Amendments of 1978) requires that 
special attention be given in the Annual Evgluation Report to the 
mainteftince of effort requirement. As noted earlier, this requirement 
is Intended to insure that an SEA or LEA does not lower its level of 
expenditures in a fiscal year (or years) so that Federal funds consti* 
tute a greater proportion of their total expenditures. This determin- 
ation is made by comparing expenditures on an aggregate or per-pupil 
basis for the two fiscal years preceding the year in which funds are 
sought* If an SEA or LEA fails to maintain its level of effort, it 
risks losing its Title I funds. (An allowance is made for exceptional 
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circumstances which lead to a decline In th^ ^in^ncU S resources of an 
SEA or LEA, but waivers are granted for one year only, and agencies 
receiving waivers may not take that year Irt^c account when computing 
the final effort In subsequent years*) 

There are three main sources of Information on maintenance of 
effort: waiver applications, audit reports, and ^ sludy completed by 
the Rand Corporation In October, 1980 entitled "^Maintenance of Effort 
Provisions: An Instrument of Federalism In Education** (Gurwitz and 
Darling-Hammond, 1980)* In the period from October 1 , 1978 to Septem- 
ber 30, 1979, four waiver requests were received and three were granted 
by the U^S* Office of Education* The reason for granting these three 
waivers was that the school districts presented special levy propositions 
to the voters which were defeated twice within a 12-month period. In 
the sinqle district where the request was denied, the district elected 
to maintain a large cash reserve In anticipation of future levy failures 
and therefore had sufficient resources to meet the maintenance of 
effort requirement. There were no Health, Education and Welfare 
Audit Agency reports with a finding that a local district failed to 
maintain effort during that particular period* 

The Rand study Involved visits to ten States. The highlights of their 
report include the following: 

0 Local districts out of compliance with the maintenance of 
effort requirement typically are poor, spend little In educa- 
tion, have a large proportion of minority students, and are 
'^Federally reliant*** Many are also small* 

0 Only 28 LEAs fell out of compliance with the maintenance of 
effort provisions between fiscal years 1977 to 1980* Of these, 
25 were granted waivers by the U.S* Office of Education* 

0 The current rules for maintenance of effort did not distin- 
guish between '^unwillingness and inability" to maintain 
spending levels. 

0 However, the Rand researchers predicted an Increasing problem 
in meeting maintenance of effort provisions due to the effects 
of inflation and the declining tax bases (sometimes the result 
of tax-limitation Initiative, such as ''Proposition IT in Cali- 
fornia and "Proposition 2 1/2" 1ft Kassachusetts) in many 
districts, particularly In the Northeast and North Central 
regions* Rand estimated t^at over 100 districts would be out 
of compliance by fiscal year 1981. 

The picture painted by Rand may be offset somewhat by revisions 
in the '^Education Consolidation and InH>rovement Act*" While continuing 
the intent of the maintenance of effort provisions, the requirement 
for maintenance Is decreased from lOOX of the previous fiscal year to 
only 90%. In addition, an LEA'S allocation will be reduced only In 
the exact proportion to which the LEA falls to meet the maintenance of 
effort requirement by falling below the 90% level. 
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Excess Costs 

The excess costs provision of Title I was designed to require 
districts to use Title I funds only for the '^excess costs of programs 
and projects*** Excess costs are defined as those which exceed the 
average per pupil expenditure of LEAs* In the final regulations for 
Title U published on Karch 27 » 1981 in the Federal Register ^ the 
excess costs proposed regulations were relegated to the status of 
guidelines* In the **Education Consolidation and Improvement Act/ 
the excess costs provision was not Included* 

Supplement,, Not Supplant 

The Intent of Section 126(c) of Title I was to have LEAs use funds 
received under this title so as to ^supplement and» to the extent 
possible* Increase the level of funds that would* in the absence of 
Federal funds* be made available for the education of pupils*** " 
The proposed rules for the supplement* not supplant provision were 
published <2s guidelines* rather than program requirements* on 
March 27* 1981* in the Federal Register* in the "Education Consoli- 
dation and Improveinent Act*" the general intent of supplement* not 
supplant is maintained* 

To summarize* provisions regarding supplement* not supplant, main* 
tenance of effort and coin^arabillty of services are provided in 
ECIA* but in general* th^ state less stringent criteria for applying 
these provisions* 

Inclusion of Important Groups in Decis1on*Mak1ng 

The Title I law not only specifies requirements for local and 
State activities* but also requires that teachers and school boards 
be Included in '^he planning and evaluation of the effort (Section 
124(1)), Similarly* pf.rents of participating children must be 
informed of the program's goals and their children's progress as 
well as make reconimendatlons and assist In helping their children 
(Section 124(j))* Parent involvement is required in a formal 
sense, also* in the establishment and operation of Parent Advisory 
Councils* Each district* as well as each school having one or more 
FTE Title I staff and more than forty Title I participants* is re- 
quired to have such a council with a majority of the elected members 
being parents of Title I participants (Section 125)* 

Parent Involvement 

Two major sources of recent information on parent involvement in 
Title I are reported on below* A **Study of Parent Involvement in 
Four Federal Programs*** In which parent activities in Title I and 
three other programs were examined in a nationally representative 
sample of districts* has been recently completed* In addition, 
parent involvefnent information was provided by all SEAs as P^'^t of 
their Title I annual evaluation reports* For the sake of complete- 
ness, information Is also presented in this section which has been 
available from some earlier studies* 
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The "Study of Parent Involvefflent" was conducted In a represen- 
tative (for each program studied) sample of districts during the 
1978-79 school year to provide national data on the extent of 
parental participation In governance and Instructional areas and 
on the coordination of parental involvement. A more Intense and 
detailed examlnat^an of parental involvement In a snaller set of 
projects* the Site Study, ms conducted during the 1979-80 school 
year. The sample vbs selected to have districts Mith greater or 
lesser degrees of parent Involvement In project governance and 
instruction, representation of both urtan and rural districts, and 
Instances of districts with differing numbers of Federal programs 
In place. Sixteen Title I sites were selected. System Development 
Corporation (SOC), the contractor for the study, looked at five 
areas In which parents participate In Title I projects: governance. 
Instruction, parent education, school support, and conmunltyschool 
relations. The highlights of the findings are summarized below: 

Project governance . Almost all parental Involvement In project 
governance occurred throuah D1str1r:t Advisory Councils (DACs) and 
School Advisory Councils (SACs). Almost every project had a DAC, 
with the majority of m&nbers being parents. However, there was 
little involveinent of the DACs In project decision-making. In 
addition, few SACs were actively Involved with decision-making 
about a school's Title I activities. While there were few highly 
Involved DACs and SACs, those that were Involved managed to make 
meaningful contributions to the design and Implementation of 
Title I projects. 

(The Sustaining Effects Study found In 1975-76 that most par- 
ents \67X) know whether their children's schools have special pro- 
grams for low-achieving students, but few (40X) know of Title I 
and even fewer participate In local governance of the Title I 
program.) 

Project Instruction . Involvement In project Instruction 
occurred through parent participation as paid aides. Instructional 
volunteers, and tu^ rs of their own children. It was reported 
that students developed better attitudes towards their work when 
their parents were Involved with the school's Instructional program, 
and In two projects where systematic home tutoring occurred there 
was also evidence of Improved student achievement. 

Other areas. Most projects offered somo form of parent educa- 
tion ,~?ncTu3Tng~pa renting skills and assisting children with class- 
work. School support activities (project activities through which 
parents can provide non-Instructional support to a school or project) 
took place infrenuently and were not a major activity where they 
occurred. Virtually all projects engaged In community-school 
activities. These activities were primarily communication and 
seldom dealt with Interpersonal relations. 
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Information on parent participation In Title I also was collected 
In the State Title I evaluation reports and Is presented In Table IU5. 
To highlight these results: 

0 Over 272»000 elected meiNbers of school advisory councils were 
parents of Title I students. Of these* 19»000 were parents 
of nonpublic school students. 

0 Nearly 399«000 elected members of councils received training 
related to school Advisory councils. Tt)us> It can be estimated 
that at least n7»000 elected members of school advisory councils 
were not parents of Title I students. (People who are not 
parents of Title I children may serve as menAers of school 
advisory councils* as long as the majority of council menAers 
are parents of Title I children.) 

0 Over 6600 LEAs provided Title I funds for advisory council 
activities. Tt)e average nuiid)er of people attending school 
advisory council meetings was 14» Including parents of Title I 
and non-Title I students as well as comminlty personnel » school 
personnel and other Individuals. 

Table 1 1-5 

Title I Parent Activity Information for 1979-80 



Advisory Councils 

Number of elected members of a school advisory council who: 

0 were parents of Title I public school students 272»556 

0 were parents of Title I nonpublic school students I9»390 

0 received training for school advisory council activities 398»952 



Parent Activities 

Number of parents of Title I students Involved in the following 
Title I activities: 



0 project planning* Implementation* and/or evaluation 387,235 
0 volunteers In the Title I classroom 126,238 
0 volunteers outside the Title I classrooms 90,410 

Number of other parents Involved In activities: 163,322 

Average number of people who attended school advisory council 
meetings: 13.8 



(Range: 4 • 116) 



Information on planning and training activities available for 
members of parent advisory councils was gathered In the "Sustaining 
Effects Study." Ttils Information Is summarized in Table II-6. 
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Table 11*6 

Parent Advisory Council Planning Activities and Training 



Type of involvement tn planning the Percent of 

district's Title I program Districts 



Regularly scheduled meetings 78 

Briefings by Title I staff 68 
PAC meetings with Title I staff to plan 

the program 47 

Mailed information on plans 34 

PAC not involved in planning the program 4 

No district Title I PAC 1 

Training topics provided to the PAC by the district 

Needs assessment, program planning* evaluation 86 

How Title I works at national » State and local levels 82 

Budget Preparation 53 

How to get people to work together 40 

Parliamentary procedures 26 

No training provided 8 

No district Title I PAC 1 



Ifrm Hinckley ( e^ d.), 197g, page 24^. 

To summarize, the numbers Of parents of Title I children who 
participated in various types of Title I a^^tivities is presented below 
in Figure n*i. 



. ,1979-60 TITLE 1 PERFORMANCE REPORTS 
^z;? Ps^nt. Participation in Title I Activities 



CWlJ.'^ln'l 

&r f v4lull.Dn 

Strvtng •* Tut* I 



lllllllllllllll 39i>Me 
♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦^ 



Figure ll-l. Title I parent participation. (From the 1979-80 Title I 
Evaluation and Reporting System reports.) 



11-18 



District Planning and Training Activities 

As noted earlier. Title I re^iuires th^t teachers in Title I 
schOOl'#» school boards, and parents be involved in the planning and 
evaluation of local Title I projects (Section U4(i) and (j)). The 
extent of such involvement is difficult to assess because "planning" 
and "involvement" encompass many different activities and interpretations, 

When asked about pUnning activities for the NIE Survey of Compen - 
satory Education in 1976-77, 84% of the Title I districts desicrlbed a 
process beginning around April (on the average) of the preceding year» 
ana mentioned the importance of district planning meetings. The topic 
most often covered at such meetings was needs assessment; least often 
Mas in-service training. Participation at such meetings is depicted 
In Table U-7. 

Table 11-7 

People Attending Title I District Planning Meetings 

Attended Planning Meeting % of TTtle I Districts 

Coo^nsatory education teachers 76 

Other compensatory education staff 68 

Non-comf«nsatory teachers 62 

Principals/Assistant principals 94 

District staff 81 

Parents 74 

{from NIE, 1978, page 116). 



A second aspect of school and comnunUy involvement, in addition to 
the planning function, is to keep interested persons inrorrod of program 
operations and effects. Only through the timely dissemination of 
program Information can involvement in program decisions be encouraged. 
Districts have a variety of ways to accomplish this, and their relative 
effectivtness is difficult to assess. A surv^ of administrators in 
213 districts in 1976-77 found districts using different numbers and 
eonbinttions of eight major information dissemination strategies, as 
shown below in Table II-8. 

In addition to Information about the training of parents and 
parent advisory council members, the 1980 State Title I reports contain 
descriptive information regarding training opportunities afforded 
to staff members. This information is summarized in Table II-9. 
No information was collected, however, on the relative intensity 
and conprthensiy&ness of training opportunities afforded to Title 1 
vs. non-Title I staff. It Is often the case that non-Title 1 staff 
treinino consists of introductory materlol to femillarize them with 
th« TitTt t progrem, while training of Title I staff maty offer more 
in-d«pth prtsentetions on program-reUted topics. 
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Table 1 1-8 

Frequencies of District Title I Communication Procedures 

Question: During this school year how many times did your district 
use the followinq procedures to Iceep such persons informed about the 

district Title I programs? 

Average Wo. 

of r^wes/Year 



District-wide meetings of all concerned persons 2.5 

Meetings of principals of Title I schools 3.8 

Meetings of teachers of Title I schools 4.0 

Meetings of District Title I Parent Advisory Council 3.9 

Meetings of School Title I Parent Advisory Councils 3.8 
Presentations of Title I information to the Board 

of Education 2.3 
Presentations in district publications not specifically 

devoted to Title I 2.4 

Stories in local news media 3.0 



jfrom Hinckley (ed.), 1979, page 247) 

Table 11-9 

Numbers of Staff Receiving Training Funded by Title I 

Title I Hon -Title I 
Job Classification Staff Staff 



Administrative Staff 6«893 10«387 

Teachers 79,096 85,620 

Teacher Aides 85,836 5,892 

Curriculum Specialists 4,601 1,642 

Other (e.g. Tutors, Community 9,243 10,764 
Aides, accounting personnel) 



The proportions of staff, both Title I and non-Title I, that 
received Title I funded training are shown in Figure II-2. 




THtolFunM 

TralnlOQ r\ 

Figure 11-2. Staff receiving training funded by Title I (H»300,37l). 
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To su«»ar1ze» Title I contains the requirement that parents of 
participating children be pemltted to participate in the establish- 
ment of programs and **are Informed of» and permitted to make recom- 
mendations with respect to» the Instructional goals of the program 
and the progress of their children in such programs/ and that 
parents are "afforded opportunities to assist their cnlldren In 
achieving such goals." 

Under ECIA» a district will no longer be required to have Parent 
Advisory Councils » but may continue those Councils If It wishes to 
do so. A related requirement In the new Act states that programs 
"be designed and Implemented In consultation with parents and teachers 
(Section 556(b)(3))." 

Evaluation of the Effectiveness of Services 

Districts must evaluate the effectiveness of their programs In 
meeting the special educational needs of participating students 
according to a schedule proposed by the State and approved by ED 
which ensures that each year the State's evaluation report Is rep- 
resentative of efforts In the State (Sections 124(g) and m(b)). 
These required evaluations must Include "objective measures of educational 
achievement* (Section 124(g)(2)) » be structured according to one of 
three evaluation models or an approved alternative (Section 183(d) 
and 45 CFR Sections U6a.170 - 116a.177)» and Include a measure of 
sustained achievement over longer than twelve months (Section 124(g)(2)). 

ECIA Chapter 1 will require districts to evaluate projects "In 
terms of their effectiveness In achieving the goals set for them* 
and that such evaluations shall Include objective measurements of 
educational achievement In the basic skills and a determination of 
whether 1nH>roved performance Is sustained..." (Section 556(b)(4)), 

Evaluation efforts undertaken by ED, by States and by local edu- 
cation agencies will be discussed In detail In Chapters IV and V of 
this report. 

Administration of Title I by State and Local Agencies 

While local education agencies (LEAs) bear the major responsi- 
bility for designing* Implementing and evaluating their programs* 
State agencies (SEAs) are responsible for the oversight of LEA pro- 
grams. In general, the responsibility for ensu-ing that districts 
comply with the law and regulations falls on State educational 
agencies. Specifically* the law provides for State approval of 
dlttrlct tppllcttlons, rule-making, technical assistance* monitoring* 
withholding of funds, program audits, and audit resolutions (Sec- 
tions 1(4-170 of Title I). To perform these duties, a State receives 
up to I.St of the total grants received by districts and agencies In 
the State or $225*0(X), whichever Is more (Section 194). 

Each LEA provides to Its SEA, In Its three year application for 
a Title I grant. Information describing Its plans to comply with 
Title I regulations* guidelines* and program criteria. Similarly* 
States are required to submit a **Kon1tor1ng and Enforcement Plan** 
describing activities to ensure that such compliance exists. 
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A 1976-77 study of State administration (NIE, 1978) found that 
States varied widely In how they administered Title I. For example^ 
some States had no general Information mailings to Title I districts. 
While others reported as many as 30; the number of conferences held 
to provide assistance ranged from 0 to 500; and the number of Indi- 
vidual visits to Title I districts ranged from 0 to over 1 »000* 

The enormous diversity was attributed to two factors; (1) a 
lack of clarity In the Federal legal framework about precisely what 
States are supposed to do, with many States confused about their 
exact responsibilities and authorities In the areas of rulemaking^ 
disseminating information, providing technical assistance, and moni* 
toring and enforcing compliance, and (2) substantial variations 
among States in the number of staff they have available to administer 
the program. 

The study noted the importance of State staffing, finding that 
those States identified as having administrations of poor quality 
had lower staffing levels than would be expected given the size of 
their set^asides, the proportion of the population that was urban, 
the number of Title I districts, and their organizational character- 
istics. A study of selected cases showed that: (1) the greater the 
efforts i) State made to clarify, record, and disseminate regulations, 
the less likely its districts were to experience compliance prob-^ 
lems, and (2) the degree of personal interaction and amount of time 
spent between State Title I officials and local district personnel 
appeared to be strongly related to the general quality of local 
district adminlstr^ition. 

Given these findings, the 1978 Amendments to Title I were written 
by the Congress to provide greater clarity in the law, and the set- 
aside for State administration was increased. Two studies are cur-^ 
rently underway to describe the effects of these changes on State 
and on local school district administrative practices. The major 
goals of these studies are: 

0 to describe how States and districts, through guidellr.c: and 
management practices, implement the provisions of Title I 

0 to describe State and local assessments of the utility and 
burden associated with various administrative requirements 

0 to identify effective State and local management practices and 
materials that can be disseminated to other sites to help them 
improve their administration of Title I and Chapter U 

While neither of these studies are yet complete, some preliminary 
highlights of each will be presented below. For the State management 
study (AIR, 198Z), these results are based upon the following: 

0 a review of state Title I management documents and ED reports 

0 a telephone survey of 49 State Title I coordinators 

0 onsite visits to seven SEAs and interviews in a sample of 35 
local education agencies (LEAs) in seven states. 
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Background Information about each State's Title I budget, staffing, 
and organization as well as other demographic data and Information about 
State characteristics was assenibled from a variety of sources, Including 
the U.St Bureau of the Census and the National Center for Education 
Statistics. This Information will be presented In an appendix to this 
report. 

State Title I Coordinators were asked to rate the Importance of 
each State responsibility and district program requirement as having 
little, moderate, or significant Importance In achieving the Title I 
program goals, and to specify the percentages of time that they and 
their staffs spent on each of their management responsibilities* Table 
II-IO presents Information on the importance of various State responsl^ 
bllltles: approval of LEA applications, monitoring, technical assistance 
and dissemination, and recordkeeping were rated as most Important in 
meetinq the purposes of the Title I program, while monitoring and en- 
forcement plans received a low rating as to their Importance* Coordln^ 
ators reported that they and their staffs spent a large proportion of 
their time on three of the four highly-ranked areas-^-approval of LEA 
applications, monitoring, and technical assistance and dissemination — 
but not on recordkeeping. 



Table 11-10 



Importance of Legislated State Responsibilities 









Percent Time 






AverageJJL 


Spent on Task 


Responsibilities 


Rank 


(Median) 


Approval of LEA applications 


1 


2.9 


18.0 


Monitoring 


2.5 


2.8 


30.0 


Technical assistance/dissemination 


2.5 


2.8 


20.0 


Recordkeeplng/flscal control sl2 


4 


2.7 


7.0 


Prohibition of federal aid 


5 


2.4 




Audits/audit resolution 


7 


2.1 


5.0 


5 ^te rulemaking 


7 


2.1 


2.0 


Access to Information 


7 


2.1 




Withholding of payments 


10 


2.0 


0.0 


Reporting 


10 


2.0 


3.0 


State applications 


10 


2.0 


1.0 


Complaint resolutions 


12 


1.7 


1.0 


Monitoring and enforcement plans*^ 


U 


1.6 





Each Item was rated on a three point scale as follows: 

1 « Little or no importance In meeting the purposes of the Title I law, 

2 ^ Moderate Importance In meeting the purposes of the Title I law, and 

3 ^ Substantial Importance In meeting the purposes of the Title I law* 

12 Time spent on recordkeeplng/flscal controls, prohibition of federal aid, 
and access to Information were combined under this category. 

13 Time spent on this task was Included In the time spent on "State 
applications*" 
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State Title I coordinators were asked to Indicate the Importance 
that they and their staffs attach to district requirements. Table II-ll 
presents the average rating and the rank of various responsibilities 
within each of these program areas. The two most Important areas were 
seen to be the targeting and eligibility of children to be served and 
the assessment of educational need, v^lle schoolwlde projects, construc- 
tion, comparability, complaint resolution, and parent advisory councils 
were among the five lowest ranked areas. (It Is Interesting to note that 
while parent advisory councils were given a low rating, parent Involvement 
was rated quite high). 



Table II-ll 



State Title I Coordinators' Ratings of the Importance of 
Legislated District Responsibilities 



Responsibility 



Funds Allocation 

Supplement not supplant 2.8 

Maintenance of effort 1.9 

Excess costs 2.0 

Comparability 1.8 

Targeting and Eligibility 

Children to be served 3.0 

Private school participation 2.3 

Oeslgnating school attendance areas 2.2 

Schoolwlde projects 1.3 

Program Planning and Oesign 

Assessment of educational need 2.9 

Purpose of program 2.7 

Control of funds 2.7 

Accountability 2.7 

Sufficient size, scope, quality 2.5 

Planning 2.4 

Other program coordination 2.2 

Teacher/school board participation 2.3 

Training of aides 2.3 

Information dissemination 1.9 

Indlvlduallied plans 1.9 

Ranking of project areas 1.9 

Jointly-operated programs 1.8 

Complaint resolution 1*8 

Non-Instructional duties 1*8 

Construction 1.4 

Evaluation 

Evaluation 2.8 

Sustaining gains 2.2 

Parent Involvement 

Parent Involvement 2.6 

Parent advisory councils 1.8 



~ Rank 
Average Rating iz (In total group) 



3.5 
19.5 
17 
?4 



1 
12 
15 
28 



2 

6 

6 

6 

9 
10 
15 
12 
12 

19.5 

19.5 

19.5 

24 

24 

24 

27 



3.5 
15 



8 

24 



14 See Table 11-10 for a description of the rating scale. 
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Prelliilnary results from the ongoing "Study of District Management 
Practices" (AdTech» 1962) tend to support the findings from the "State 
Kanagement Practices" study» at least In terms of activities and 
responsibilities judged beneficial overall to the proper functioning of 
the Title I program. Figure n*3 summarizes the ratings of district 
personnel of the Importance^ and relative burden^ of various local 
administrative activities. District personnel felt that while four 
activities were burdensome (parent 1nvo1ven»nt» evaluation^ c<Hnparab111ty 
and student selection)^ two of those were considered to be necessary 
(student selection and evaluation) while two were rated as being somewhat 
unnecessary (comparability and parent Involvement). Complaint resolution 
and excess cost requirements were considered the least necessary » though 
neither was judged to be particularly burdensome. 



Host Burdensome 

I 



PI 



EV 



CO 



SS 



Least 














Necessary 






It « 






X 


ME 


SP 


X X 





EX 



Most 

Necessary 



QU 



CR 



Least Burdensome 



Key; SS 


' student selection 


PI 


= parent involvement 


EV 


« evaluation 


ME 


= maintenance of effort 


TG 


» targeting 


EX 


= excess costs 


OU 


» adequate s1ze» scope and quality 


CR 


= complaint resolution 


SP 


' supplement, not supplant 


CO 


= comparability 



Figure II-3. District Ratings of Burden and Importance of Activities 
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Additional Information on the characteristics of States and local 
educational agencies* particularly with regards to the nature of their 
compensatory educational programs* Is presented In Chapter In. In 
addition* a report being prepared by the ED Office of Elementary and 
Secondary Education summarizes the Progress made In Implementing the 
monitoring and enforcement plans developed by each SEA. 

3d 
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Chapter I of ICIA will enact substantial changes in the nature 
of the State role and responsibilities for overseeing compensatory 
education programs* State agencies '*sha11" approve local applications 
If the program assurances described earlier are provided (Section 556(b))<. 
States must keep records ard provide Information to the Secretary as 
needed for fiscal accountability and program evaluation {Section 555(d))* 
However, the role of States In monitoring and enforcing local programs 
Is greatl/ reduced (Section 596(a)), and the State administrative 
set-aside has been reduced to a maximum of It of the total grants 
received, with a minimum payment of $225,000 per year (Section 554(d))* 



PROGRAMS OPERATED BY STATE AGENCIES (PART 8 PROGRAMS) 

Three programs are specifically created in ESEA to be admin* 
istered by SEAs: a program for migratory education, a program for 
hfindicapped children, and a program for neglected and delinguent 
children* 

Two of these subprograms the migrant education program and 
the program for institutionalized neglected or delinguent children 
have recently been extensively studied, and the results of these 
evaluations have been transmitted to Congress* The executive sum- 
maries of the evaluations of the migrant education program and the 
program for neglected and delinguent children are attached as appen* 
dices to this report* The executive summaries contain descriptions 
of the scope and operations of the programs as well as the evaluation 
findings and recommendations; hence, they will uot be discussed 
here* For more comprehensive descriptions of these Part 8 programs, 
the reader is referred to the Oepartment of Education's 1981 Annual 
Evaluation Report * 

The Title I handicapped program, which is a<biiinistered by ED's 
Office of Special Education and Rehabilitative Services, similarly 
win not be discussed here, primarily for two reasons: (1) the 
program is being considered for inclusion into a larger "Special 
Education** block grant, and (2) a study is now being planned, to 
begin by the Fall of 1982, of how the program operates and how 
effective its services are at meeting the legislated goals* The 
study will be able to provide Information which will describe the 
block grant^s effects on services and on participants* A description 
of the current program's goals and operations Is provided In the 
1981 Annual Evaluation Report* 
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THE NATURE AND IHPLEHENTATION OF COMPENSAT ^^^-^ EDUCATION PROGRAMS 

The purpose In Chapter III Is to provide a de«r1pt1on of Title I 
projects as they are currently carried out by loca* education agencies 
(LEAs)* Intormatlon on the following aspects of Title I will be provided; 

0 Number:; of public and private students served by Title I» 

0 Characteristics of schools and students receiving Title I services^ 

0 Staffing patterns of Title I projects^ 

0 Types of services provided^ 

0 Information on summer school programs* 

Several sources were utilized to obtain this information* Including 
reports submitted by State Education Agencies (SEAs) and the results of 
national st Hes* The Executive Summaries of special studies of Title I» 
Part 8 (State operated) programs are provided in appendices* 

Sources of Information 

Information on Title I programs was available from several sources* 
the most recent of which are the Title I Evaluation and Reporting System 
(TIERS) and the Sustaining Effects Study (SES)* An o1der» but still 
useful » source is the NIE Survey of Compensatory Education * A brief 
description of each source of infoniiatton follows: 

Title I Evaluation and Reporting System (TIERS) * ED received TIERS 
reports from all :>EAs with Title i programs* (The development and imple- 
mentation of this system Is decribed in greater detail In Chapter V of 
this report*) Information collected as part of this system Includes: 

0 Numbers and characteristics of students served* 

0 Nature of the services provided » and 

0 Numbers and characteristics of staff and others (parents* admini- 
strators* etc*) who work in Title I* 

The State performance and evaluation information was collected 
using a standard form (ED 686-2)* The 1979-80 school year was the first 
year of nationwide implementation of the system* Reports were received 
from SEAs during the spring and summer of 1981 and numerous revisions 
were made as State and Federal personnel reviewed the forms during the 
summer and fall * 

Sustaining Effects Study * The Sustaining Effects Study (SES) is a 
five year longitudinal study conducted by System Development Corporation 
(SDC) of Santa Monica^ California* The study was designed to detemine: 

0 Who receives compensatory education* 
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0 What compensatory education* 

0 ^low effective Is compensatory education* 

0 What happens to the achievement of students when their compen^ 
satory education services are discontinued* 

0 What happens to student achievement over the summer* and Is 
summer school effective* 

The stu<ty covered students In grades one through six* and Initial data 
collection occurred in the 1976-77 school year* Achievement data were 
collected over three contiruous school years* and will be discussed In 
Chapter IV of this report, 

WIE Survey of Compensatory Education , The NIE Survey of Compensa- 
tory bducation was conducted In a random sample of Title i school dis- 
tricts during the 1975-76 school year. Interviews were conducted with 
State and district administrators* school principals* regular classroom 
and compensatory education teachers, and PAC chairpersons* Results 
were reported on the scope of compensatory education* the range of ser- 
vices provided with Title I funds* the characteristics of the students 
served* and the characteristics of compensatory Instruction, 

Who Receives Title I Services? 

Information was available on the types of schools and students who 
receive Tit^e I services* Including information on both poverty level 
and achievement standing. This information is summarized below* 

Selection of Elit'ible Schools 

District practices result in Title I programs being offered more 
often in schools with larger proportions of their students from families 
in poverty* as shown in Figure IINl* It ts clear that as the propor- 
tion of students from poverty backgrounds increases in a school* so too 
does the likelihood that it will be a Title I school* Schools with high 
concentrations of students from poverty background are almost certain to 
have comp^nsatury education programs (only 5% receive no compensatory 
funds)* 

As noted in Chapter H* it is possible for schools to be declared 
''Title I eligible*^ if they have large proportions of educationally 
deprived children (but not necessarily large enough proportions of 
economically disadvantaged students to rank high in the district's 
ordering of schools according to the poverty of their attendance areas)* 
It is interesting to note the correspondence betvfeen economic and 
educational deprivation of attendance areas* oarticularly since the 
question of whether Title I is designed primarily to serve the educa* 
tionally deprived vs* the econo^iically disadvantaged is periodically 
resurrected* 
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Figure IINZ shohrs the numbers of schools with different propor- 
tions of educationally deprived students offering Title I progrtiNS* Die 
pattern Is similar to that In Figure IINl* In fact» the correlation 
between the number of educationally disadvantaged students In a school 
and the number of economically disadvantaged ones Is t67t Die corre- 
lation between those two numbers for schools within the same dj^^trlct 
is even higher — *91 (Bregllo* et aK» WByi Host scnoois 
having greater than half of their students from poor homes and greater 
than half performing at least one year below grade level ofTer Title I 
programs {97t offer Title I or some other compensatory program)* The 
3t of these schools which do not have any compensatory program (Title 
I or something else) are most often located In urban settings* 
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Figure IIl-l, Eleiaentapy schools with differing proportions of students 
from poverty backgrounds. 
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Stiection of Students 

Title I services are supposed to ""ineet the special educational 
needs of educatlo^^rlly depriwd children" attending school 1r the eligi- 
ble attendance ^.cas* The current regulations state that a district 
muf^ use ""specified criteria and»to the extent posslble-^objectlve data 
to select ««« those educationally deprived children who are In the 
greatest need of assistance (Federal Register* Vol^ 45» Ko« 114» 
June }}p 1980» page 39751 » Section 116aJ03)« 

It Is difficult to assess how adequately local procedures achieve 
the intent of the regulations due to differing definitions of educa- 
tional deprivation and greatest need* Analyses of targeting of services 
on ^tudents found that 75% of the schools in the "Sustaining Effects 
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Figure II 1-2. 



Elementary schools with differing proportions of 
educationally deprived students. 
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Stucty** (wlilch formed a representative sanple of the Nation's schools 
serving grades 1-6) had more than half of their Title I students falling 
at or below the 35th percentile on the nationally standardized reading 
test used In th« stucly (Kenoyer and Cooper, 1980}. (The 35th percentile 
represents a level of performance below which most teachers judge stu- 
dents to need compensatory services.) 

Another way to assess the adequacy of selection procedures Is to 
assess the degree to which, for each school, the low-achievers tend to 
be In Title I and the higher achievers not. This can be examined by a 
correlation between student achievement ranks on standardized reading 
tests and whether or not each Is In Title I* These correlations are 
almost all positive In reading, but not strongly so. The average 
correlation across schools was .37 in reading and .24 In math (Kenoyer 
and Cooper, 1980). 

It Is also possible to depict student participation In Title I 
separately for each quartlle of the achievement distribution. The 
figures for grades 1-6 according to the "Sustaining Effects Stucly" ere 
shown In Table III-l (Bregllo, 1978)* 

It Is Important In reading Table III-l to note that the percentage 
figures add to 1(K)X by row (except for rounding errors): that Is, for 
example, 32% of the Nation's students In the bottom quartlle are In 
Title I; 14% of the students In that quartlle receive services only 
from other compensatory programs: 42% are In schools with compensatory 
programs but receive no services ^; and 11% are In schools which have 
no compensatory programs. Difficulties In targeting services on the 
neediest Is evident In this table since 457,000 (16% of the students In 
Title I) i^laced In the upper half of the distribution (left column, 3rd 
and 4th rowf ). Possible explanations include problems with tests &nd 
teacher ot*' parent preferences for certain students to be In Title I. 

Additional Information Is available from the TIERS. The results 
of the achievement testing provide an estimate of the standing of 
Title I students through the weighted mean pretest scores submitted by 
States. This information Is provided In Tables III-2 for reading and 
mathematics for students tested on an annual testing schedule (either 
fall-to-fall or spring-to-spring). Considerable variation was found 
among the States on the pretest standing of the Title I students (for 
those with both pretest and posttest scores for a given subject arii) as 
well as between the pretest standing of those tested In the fall versus 
those tested In the spring. The posttest standing of reading and mittie- 
fflfttlcs students tends to be similar for students tested on a fall-to- 
spring schedule and for those tested on an annual schedule. 



1 Of particular Interest Is the 42% figure, showing that many students 
scoring poorly on standardized instruments do not receive services 
even when they attend schools that offer compensatory education 
programs. A combination of factors has been suggested: poor selec- 
tion procedures, funding levels too low to serve all needly children 
and. In some cases, the lack of Title I programs at cerUIn grade 
levels. 
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TabU m-I 

Achievement Status and Participation In Coitipensatory Education* Grades 1-6 

Conpensatory Students Not In 

Achievement Education Part1c1pa.nts Compensatory Education 

St a tu s Ot he r In Comp. in School 

Title I Coop, Ed, Ed, School w/out Comp, Ed. 

No. {X ) No. i%) No, i% ) No. it) 

Bottom Quart! le 1»579»000 (32) 718,000 (14) 2»no»000 (42) 560»000 (11) 

2nd Quartlle 910»000 (19) 543»000 (11) 2,d09»000 (58) 605»000 (U) 

3rd Quartlle 368»000 ( 7) 411,000 { 8) 3»600»000 (70) 762»000 (15) 

Top Quartlle 89»000 ( 2) 301,000 { 6) 3»772»000 (75) 869»000 (17) 



Table m-2 

1979-80 Title I Pretest Standing for Students Tested 
on an Annual Testing Cycle (in Percentiles) 



Grade Reading Mathematics 





Hlnlmum^ 


Ave rage 3 


Maximum^ 


Minlr'jiD 


Average 


Naxifflum 


2 


9 


28 


50 


12 


35 


48 


3 


6 


23 


41 


9 


31 


50 


4 


II 


23 


39 


9 


28 


49 


5 


9 


22 


40 


8 


26 


49 


6 


9 


22 


39 


3 


24 


43 


7 


7 


22 


43 


8 


23 


39 


8 


10 


22 


40 


9 


23 


44 


9 


9 


20 


37 


8 


23 


46 


10 


7 


17 


39 


9 


21 


52 


11 


6 


14 


24 


7 


24 


49 


12 


5 


12 


28 


8 


22 


51 



Ml4 



2 The minimum is the lowest reported pretest score of all SEAs 

at least 100 students tested, 

3 The average Is the percentile equivalent of the weighted average 
NCE score of all reporting SEAs, 

* The iMxIiium Is the highest reported Pretest score of all SEAs with 
at least 100 students teste'j. 
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For reading , across all States, students teste^i on an annual sched* 
ule averaged at the 22ni peixerttlle in the elenerttary grades. Sow 
States report pretest figures much higher or loi«r than this, however. 
At grade 2. the lowest percentile was 9 and the highest was 50. (In the 
extreme, a rough estimate shows that In one State about half of the 
students fell below the 9th percentile, while In another State about 
half fell below the 50th percentile, based on students with both pretest 
and posttest scores.) 

For mathematics , the students tested annually showed national per- 
centile standing ranging from a high of the 35th percentile at grade 2 
to a low of the 21$t percentile In grade 10. Considerable variation was 
found among the scores reported by States, with percentiles at grade 4 
varying from a low of the dth percentile to a high of the 49th percen* 
t^le. 

Other aspects Involved In "targeting** Involve the ntmbers of stu- 
dents with different characteristics being served by the progran (as a 
consequence, presumably* of the selection procedures emphasizing educa- 
tional need). Data on the sex. age and language groupings of partici- 
pants In Title I are shown In Table III-3 (as reported In the 1980 
Annual Evaluation Report and dating from Fiscal Year 1977; froK the 
"Sustaining Effects Study,") 



Table III-3 



Characteristics of Title I Participants In Grades 1-6 
(Sustaining Effects Study) 



Language 



English spoken at home 
Spanish spoken at home 
Other language spoken at home 



2,470,000 
353,000 
113.000 




Age 



5-6 years 



7 
8 
9 

10 
11 
12 



354,000 
506,000 
519.000 
503,000 
510.000 
418.000 
128.000 




Female 
Nale 



1,094.000 
1.412.000 



(44) 

(56) 
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In addition* on the TIERS forms* States were asked to record the 
mMt>er of Title I students during the regular tern of 1979-80 according 
to five ethnic groups: American Indian or Alaskan Native, Asian or 
Pacific Islander* Black not Hispanic* Hispanic* and White not Hispanic. 
Each student MS to be counted In only one Qro\i\t* Nine SEAl did fiot 
report tthnlc group infonwtlon, tnd othir SUtii utid iitlmtii or hid 
Incoflipliti Informtlon. Ttbli ni»4 prtiinti thi tthnie g^up ehinet«p- 
litlei of TUli I itudtnti for thi rtportint SEAi and for til S£Ai uting 
•ttlmatM for the musing diu. Thi tnluing dat« w«rt estimated by usi 
of 1970 Bureau of Census p<H»u1ttt10n estimates to proportion the Tlllt t 
students Into ethnic categories. This procedure Mill probably over* 
estimate the nunber of white not-Hispanic Title I participants. 

Based on available Information* It Is estimated that slightly over 
one-half of Title I participants during the regular term of 1979-80 were 
white not-Hlspanlcs* slightly more than one-quarter were Black not- 
Hispanic* between one-seventh and one-sixth were Hispanic* and less than 
5% were Asian* Pacific Islander* or American Indian. 

The TIERS data on race was provided by several States who did not 
have actual counts available and thus had to estimate. Other estimates 
of these counts come from NIE* 1977* and are based on a 1976 sample: 
White (54X), Black (34.5X)* Hispanic (10%) and other (1.5X). 





Figure III-3. Ethnic characteristics Of Title I participants based on 
States reporting ethnic data In 1979-80. 
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Ethnic Characteristics of Title I Participants 
During the Regular School Term In 1979-80 



All reporting SEAs ^ (TIERS) 



Ethnic Group 


Nuifber 


{ %) 


White* Not Hispanic 


2»490»868 


(51) 


Black, Not Hispanic 


1»399»044 


(29) 


Hispanic 


768»S42 




Asian or Pacific Islander 


98»207 


n 


American Indian 


93»785 


i 2) 



All SEAs6 (TIERS) 

Ethnic Group 

White » Not Hispanic 
81ack» Not Hispanic 
HUpanIc 

Asian* Pacific Islander* 
or American Indian 

Sustaining Effects Study 

Eti.nic Group 

White, not Hispanic 
Black » not Hispanic 
Hispanic 
Other 



Number 

2»947»006 
1»466»833 
774»529 
192»577 



Number 

1»762»000 
740 » 000 
328»000 
S8»000 



{ %) 

il 

( 4) 



(61) 
(26) 



I Nine SEAs did not report ethnic breakdowns, 

^ State population data were used to estimate missing Information. 
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Wumber of Students Served by Title I 

States Mere required to report the number of Title I participants 
during the regular term of by public and nonpublic designation 

and grade level. Participants in local, but not State, Institutions for 
neglected or delinquent children were to be included, Any student who 
received any amount of Title I futided Instruction In a subject matter 
area was considered to be a participant, and each student was to be 
counted only once regardless of the number of subject matter areas In 
which he or she received Instruction. Participants In ungraded classes 
were to be assigned to grades on the basis of age at the beginning of 
the school year, (See the Handbook: instructions for Title I Reporting . 
1980 for complete information,) 

Data were received by all 56 SEAs (see Table 111-5), However, some 
SEAS reported pupils In ungraded classes In the totals but not In the 
Individual grades, and some SEAs did not report local Neglected or 
Delinquent program students by grade level and publlc/nonpubllc desig- 
nation; therefore the rows and columns In Table 1 will not add to the 
total number served. 

Table m-5 

Number of Regular Term Title I Participants by Grade Level 
and Public/Nonpublic Status During 1979-80 



Grade 



PublIcZ 



nonpublic 



Total 



number ( %) number ( %) 



number ( %) 



Pretclndergarten 
Kindergarten 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 
11 

12 



Total 
ToUl 



8 



61,587 
293,182 
616,131 
666,218 
673,650 
616,716 
601,055 
501,515 
383,588 
312,929 
21 2,465 
122,516 
69,100 
40 » 283 



( 



1) 
( 6) 
(12) 
(13) 
(13) 
12) 

IS! 

i 4) 

1?! 

( 1) 



(Including ungraded) 



5,170,935 (100) 
5,173,718 



677 


(0,4) 


62,234 


6,666 


( 4) 


299,848 


20,917 


( 11) 


637,048 


26,849 


( 14) 


693,067 


27,439 


( 14) 


701,089 


25,834 


( 14 


642,550 


23,404 


( 12) 


624,459 


20,675 


( U) 


522,190 


1 3,486 


397,074 


10,585 


i l\ 


323,514 


6,374 




218,839 


3,005 


125»521 


1»797 


( 1) 


70,897 


1,176 


( 1) 


41,459 


188,884 


(100) 


5»359,819 


189,654 




5,402, 341^ 



13) 
12) 

i 

4) 

2) 
( 1) 
( 1) 




7 8IA students were Included In the Public cate9ory. 

^ Som reported pupils in ungraded classes In the totals but not 

In Individual grades, 
9 Sone SEMs did not report local N or D students by grade level and 

publlc/nonpubllc designation, 
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Percent of THIe I Partlclpanto by Grad* 

(MIttAatwvwD 




Gmlt 



Figure III-4, Percent of Title I participants by grade level. 



During 1979-80. approximately 5.4 minion students were served by 
programs funded by Title I grants to local education agencies. Approxi- 
mately 3.9% of these students were 1n nonpublic schools* and the najority. 
both In public and nonpublic schools, were In the elementary grades. 
Approximately 72% of public school participants and 76X of nonpublic 
school participants were In grades 1 through 6. Only 8% of participants 
were In grades 9 through 12, and 7% were In preklndergarten and kinder- 
garten programs. 

Public School Participation 

Forty-four SEAs reported serving public school students at the 
prckindergirten level, -owever, the (tajorlty of these SEAs served saell 
nunbers of students; only 23 SEAs served more than 500 students at the 
prekindergirten level. Fifty-four SEAs served students at the kinder- 
garten level; 41 served more than 500 kindergarten students. All 56 
SEAs served students in grades I through 3, all but one SEA (the District 
of Coluiibia) served students In grades 4 and and all but two SEAs 
(D.C. and Gum) served public school students in grade 6. At the junior 
high and high school levels the nunber cf students served decreased 
rapidly* especially at the higher grades. In grades 12. only 40»283 
public school students were served by Title I programs. 
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nonpublic School Participation 

Fourteen SEAs reported serving nonpublic school students at the 
prekindeigarten level; only 677 preklndergarten students were served 
nationwide. Thirty-five SEAs served kindergarten students* and all 
SEAs except the BIA (all BIA students were included in the public school 
count) served students at some combination of grades 1 through 12. 
Nonpublic participation decreased rapidly after grade 8» however, and in 
grade 12 only 1176 students In 27 SEAs were in Title I programs^ 

Participation by Local Institutions for the Neglected or Delinquent 

SEAs reported the total nunber of Title I participants during the 
regular tem in local (not State) institutions for neglected or delin- 
quent children. Eiich student was to be counted once regardless of the 
number of times he or she entered a local institution for neglected or 
delinquent children. Forty-two SEAs reported serving a total of 71»364 
students. The range of the number of students served was from 41 to 
33»S99. Twenty States reported serving more than 500 students and 13 
reported serving fewer than 250 students. 

Percent of Population Served by Title I 

In order to obtain an estimate of the percentage of public school 
students who were served by Title I programs (Table in-6}» the total 
elementary and secondary public school enrollment in the fall of 1978 
(National Center for Education Statistics figures) was used. The en- 
rollment included the 50 states plus the District of Colund>ia. (Enroll- 
ment figures for the fall of 1979 were not available at the time the 
analyses we' iiade for the 1979-80 Title I data.) During the 1979-80 
school year» 4»929»504 students from the 50 states plus the District of 
Columbia were in Title I programs; using the 1978 enrollment as an esti- 
mate of the 1979 enrollment, it can be estirated that approxirately 
11. 6t Public school students were served by Title I . 

Estimates were not made by grade level but it is speculated that a 
larger percentage of students were served at the lower grades than at 
the higher grades. The percentage of students served varied across 
States from 4% to 26t. The 14 States with State compensatory education 
programs serving populations similar to Title I served 11. 9t of their 
students with Title I programs; States without such State codipensatory 
education programs served 11.2% of their students by Title I. 

Nonpublic institutions served 189»654 students in Title I programs 
in 1979-80. NCES figures for 1978-79 estiimted that there were 5»DB5»633 
private school students. Therefore, the approximate percentage of non- 
public school students served was 3.7X . 

States with compensatory education programs serving similar types 
of students as Title I reported serving approximately the same percent- 
age of students In Title I as did States without such programs. 
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Table 1 1 1-6 



Percent of Students In Title I Programs In States With and 
Without State Compensatory Education Programs 





number of FY 80 


19/8 










Public School 


ScnoQi 


Percent 


Served In 


Title I 




Title I 


Enrollment 










Students 




Average 




Range 


States Mith 


2,584,522 


21 «640«352 


11 .9 


6.6 


- 18.6 


state compensatory 










education 












pro<;rams 












States without 


2,344,982 


30« 919*584 


11.2 


4.0 


- 26.3 


state compensatory 










education programs 










All 51 States 


4,929,504 


43 « 559*808 


11.6 


4.0 


- 26.3 



Title I Staff 



Table IH-6 presents the number of staff twmbers eit^loyed full -time 
In Title I projects during the regular term of 1979-80. Staff members 
who worked for Title I projects for a greater percentage of time than 
they were paid with Title I funds were counted in terms of the amount of 
time that they worked in Title I, not the amount of time that they were 
paid by Title I. (For example, if a teacher worked full-time in a Title 
I projects, but 25% of his salary was paid with district funds, the 
teacher would be counted as one full-time equivalent, not .75 FTE.) 
Staff members were recorded in seven categories; administrative staff, 
teachers, teacher aides, curriculum specialists, staff providing sup- 
porting services (such as social work, guidance, psychological coun- 
seling, health, nutrition, attendance, library, speech pathology, audi- 
ologiy, evaluation, and psychological testing services), clerical staff, 
and other (e.g., accountants, bookkeepers, custodians, vehicle opera* 
tors, food service personnel). 

Table m-7 

Nuntber of Staff Employed in Title I Projects During the 
1979-80 Regular Term in rull-Time Equivalents 



Job aassification Full-Tiwe Equivalents ( %) 



Adninistrative Staff 

Teachers 

Teacher Aides 

Curriculum Specialists 

Staff Providifig Supporting Services 

aerical Staff 

Other 

Q Total 

ERIC 



6,312.0 
7»,494.8 
91.457.2 
6,241.8 
6.303.7 
5.076.4 
6.607.6 



t 3) 
[39) 

[46j 

I 
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Over 200,000 full-tlne equivalent staff meinbers* or one for approxl- 
netely every 27 Title I students, served the Title I program during the 
regular tern) of i979-80, Thfrty-nlne percent of the staff neiibers were 
teachers and 46S Mere teacher aides; thus 85X of the staff were directly 
Involved Mith providing educational services to Title I children. 
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Figure III-5, Title I project staff during the regular term of 1979-80, 



Types of Services Provided 

SEAs reported through TIERS the number of Title I participants 
during the regular term by type of service and public, nonoubllc. and 
local neglected or delinquent designation. Table III-8 presents this 
Information. Service areas Mere divided Into instructional areas and 
supporting areas, as foUoMs: 

0 Instructional areas: Reading 

Hathematlcs 
Language Arts 

English for limited-English speaking 

students 
Vocational 

Special services for the handicapped 
Other ( Including as natural sciences, 
social sciences and social studies* 
business, health, safety driver and 
ptyysical education, and Industrial 
arts) 
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0 Supporting areas: Health and nutrition 

Attendanc''^ social work* guidance and 

psycholojty 
Pupil transportation 
Other 

A student v«as courted once for each Instructional area in which he or she 
received services and once for each category of supporting services that 
he or she received. 

All except one SEA (the BIA) reported the number of stuoents sev'ved 
by service area. Based on the SS SEAs which reported this Information* 
4J97»336 (78X) of the Title I participants received services In reading. 
The second must comnnnarea for si^rvlces was mathematics (2,483»044 stu- 
dents^ or 46%). The three next most common areas* health services (28X)» 
lang^ge arts (191), and other Instructional services (19X)» together 
served fewer s^'udents than were served by reading. The fewest students 
were served by programs In vocational education (only 7 SEAs reported 
programs In this area) and special activities for the handicapped (14 
SEAs repo;*ted programs). 

Public School Participants 

In 1979-80, reading continued to be the most common service area In 
Title I. Over four million public school Title I students (7S^) received 
services In reading. Hathemtlcs, with over 2.3 million students served 
(47%) was second, and health and nutrition services, with over 1,5 mil- 
lion students (29X) was third. Over one million students were reportedly 
served by other Instructional areas; three-quarters of these students 
were In one State (California), which reported that the students In this 
category primarily received multicultural services. Other common areas 
were language arts progrants In Spanish (Puerto Rico) and early chMdhood 
projects. 

Honpubllc School Participants 

Nearly 190,000 nonpublic school students received Title I services 
during the r^ular term of 1979-80. Seventy-eight percent of nonpublic 
Title I mrtlclpants received service* 'r reading. This percentage is 
comparable to the percentage >f pubi;c ool Title I students who 
receive reading. The percentage of I students who receive mathe- 
matics Instruction funded by Tlt^e I was 36% r nonpublic versus 47% 
for public students. Ho mere than 9X of the iionpuhllc Title I students 
received services In imf of the other Instructional or support services. 

Participants In Local Institutions for the Neglected or Callnouent 

Over 71,000 stud««ts were reported to have been served by Title I 
programs In local Insti utions for neglected or delinquent children. 
More of these students (49%) received services In reading than In any 
ether area. Approxlwtely 30% of the students received Title I mathe- 
matics instmctloni no more than 11% of the students received services 
in any of the other Instrt- .lonal or support areas. 
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Table 11 1-8 

Title I Participants by Service Area During the Regular Term of 1979-80 



Service Area Type of Participant Total ^0 





Public 




Nonpubll 


c 




Local H 


or r 




numoer \ 




nUimier 


7" 


-ST 
»J 


NuiTDer 


( %) Number [ t) 






















Reading 


4,009,200 


(79) 


148,972 


0 


'8) 


34,917 


(49] 


4.197,336 


;78J 


Hathematlcs 


2,388,955 


(47$ 


68,875 


h 


16) 


21,551 


(30; 


2.483.044 


46) 


Language Arts 


1.030,307 


(20) 


16,784 






3,583 




1 1,053.144 




Other 


1,014.714 




1 £ Q1 Q 
1 D^OI O 


I 


9} 




\l. 


\ 1,039,651 


19) 


Limited English 


351,822 




12,440 


{ 


7) 


1,602 




1 374,590 


; 7) 


Vocational 


5,087 




39 


{• 




15 




5,571 




Special for 


7,623 


1::', 


1,320 


i 


Tl 


141 




1 9,084 




Handicapped 




















Supporting 




















Health. Nutrition 


1,504,674 




12,464 




7) 


1.660 


( 2) 1,518,798 


m 


Attendance* guidance 767«845 


n\ 


16,755 


I 


9) 


8,015 




) 792.615 




Other 


408,841 


( 8) 


10,186 


( 


5) 


2,043 


Pi: 


\ 421,070 


I 8) 


Transportation 


132,637 


( 3) 


4,877 


( 


3) 


634 


( 1) 138,14P 


t 3) 


Total Number Served 


5,102,32411 


189,654 






71,364 




5,402,311 





Some States counted N or D puolls tMlce (the N or D pupils are Included 
in Public and Nonpublic as wetl as the N or D column); others listed 
only Totals with no Public, Nonpublic and N or D breakdovms. Therefore, 
the Total column Is not the sum of the other three columns. 

This number Is an estimate obtained by subtracting all local Neglected 
or Delinquent participants from the total number of Public partici- 
pants. Since some local Neglected or Delinquent participants may be In 
Nonpublic Institutions, the number underestimates the number of Public 
participants not In Neglected or Delinquent programs. For the same 
reason, the number of Nonp4Jbl1c participants is an overestimate. 
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Figure lU-6, Participation by instructional service area fiuring the 
regular term of 1979-80, 



The Nature and Intensity of Reading and Mathematics Services 

It was noted previously that it is hard to analyze costs or services 
in education using per-pupil expenditures, in two national studies of 
Title I, an analysis method has been used wtiich Involves estimating the 
amount and type of educational resources (teacher training and time of 
instruction, type of materials, etc.) to which students are exposed. 
Then, the method applies to each resource an estimate of Its average (or 
"standard") cost. Hence, for each Title I student or group of students, 
one can record the "Inputs," or resources used, multiply each by Its 
estimated standard cost, and sum across resources. This yields an esti- 
mate of per>pupi1 costs attributable to the particular educatlctnal acti- 
vity rather than to local salary and expense schedules. CoRiparlsons 
across sites and various analytical efforts (relating costs to degrees 
of effectiveness for example) thereby become more meaningful, (See 
especially Haggart, 1978, for more discussion of this technique.) 

It Is possible, through this method, to note the costs of programs 
received by Title I students in contrast to ti.*,se received by their 
peers. Results of these analyses were presented In detail In the 1980 
Aimml Evaluation Report , and will not be repeated here. In sumnary. 
Figure ttt-7 (describes the comparison of "standard" costs for both Title I 
and Non-con^ensatory students, in reading and In mathematics. The 
resource costs cstlnated include those due to teaching personnel, support 
(clerical aides and other auxiliary personnel), and equipment and mate- 
rials. 
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Of Interest in Figure lU-7 Is the clear differtfjce between ihe 
amounts of resources comprising reading and nath programs for Title I 
and noncoopensatory students. For both reading and mthematlcs. the 
Title I students sire offered substantlalV more services /resources than 
are offered to their non-conpensatcry peers. The amount and the patterns 
of supplenentary service allocations vary spmeMtuit across grades,, es 
shown In Figure 3. with the resources devoted to compensatory reading 
greatly Increasing as the grade level Increases (although the total 
anouni of resources devoted to reading declines, and the amount of re- 
sources devoted to non-compensatory residing declines dramatically). The 
level of regular mathematics resources allocated reraalr.^ fairly constant 
across the grade levels, while the amount of compensatory mathematics 
resources increases slightly. 

Although, as has l^een noted, estimates of per-pup11 expenditures 
are difficult to cor.ect from districts, ahi* where available are sub- 
sequently difficult to interpret (due to different accounting methods, 
etc.). rough indicators of Title I efforts do exist. A survey of IQO 
Title I districts estimated the Title I per pupil expenditures to be 
$347 In 1975-76 (NIE. 1976). An estimate for the following year from 
the Sustaining Effects Study was I4l5. compared to $317 per-pupl^ from 
:>^dc1a1 district or State compensatory education programs (Hemenway. et. 
al., 1978.) 
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Figure 111-7. Estimates of services to TltU I and non-compensatory 

students; reading and mathematJcs. grades 1 - 6 (1976 data). 
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To repeat some of tht observations noted above* and In an attenpt 
to describe what accounts for the majority of the differences In costs 
betweer< services received by Title I and non-compensatory students* 
It should be noted that: 

0 especially In grades 3-6, Title I students receive more hours 
of services In reading than their non-compensatory peers, 

0 Title I t.tudents all of grades 1-6 receive more math, 

0 Title I services are more often in ^nailer droups, and/or 

0 those services are more often offered by a subject area 
specialist. 

These figures about specific measures of services In reading 
and math taken from a study In public schools. There Is little 
comparable Information to describe services to non-public students. In 
a sample of 214 Title I districts in 1977-78* 98, or 46% of the district;, 
were providing services to non-public students; most of those services 
(ir 89 of the 98) were provided in the non-public school Itself; and 
!n)St of them (in 9Z of the sites) offered the services during norml 
school hours (Hemenway* ^ a],.* 1978). 

Projec c Characteristics 

States reported on various characteristics of their Title I projects 
in grades 2, 6* and 10* Including the project sev.t1ng* the student to 
teacher ratio* the hours per week of Instruction* the total hours of 
instruction* and the total nunter of weeks of Instruction. These fig- 
ures are reported in Tables III-9 to Ul-12 by the percent of students 
falling Into each category by grade level and subject area. 

Project Setting 

The type of setting in which the Title I project took place was 
characterized as regular cla^* pull-out* laboratory (where Instruction 
used machines primarily or exclusively)* or a combination of methods. 
Table III-9 shows that students are more likely to be served in pull-out 
projects than in any other setting. This is especially true for reading 
projects in grades Z and 6. Few students are served by laboratories 
using nachines for instruction* and few dre served by co«i>i rations of 
methods. Language arts projects are more likely to be In the regular 
class than are reading and nathenBt1c$ projects* but even in language 
arts less than one-half of the students are served In the regular 
class. 

Amount of Instruction 

The' amount of instruction was measured by two variables: the murfwr 
of hours per week that the typical student received Title I Instruction 
In the subject area and the total nu(*er of hours of Title I Instruction 
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Table III 9 



Percent of Students In Different Types of Project Settings 



Subject 


Grade 






Project Setting 












Regular 


Tu i l-(Xtt 


Lab 


Megular 


Regular 


Pull -Out 


Other 






Class 






Class a 


Class a 


a Lab 














Pull -Out 


Lab 






Reading 


Z 


12% 


69% 


3% 


8% 


3% 


3% 


2% 




e 

0 




02% 


7% 


8% 


3% 


5% 


z% 




10 


30* 


41% 


7% 


5% 


6% 


3% 


9% 


Hath 


z 


1« 


53% 


4% 


10% 


4% 


2% 


8% 




6 


14% 


58% 


7% 


s% 


5% 


2% 


6% 




10 


23% 


42% 


3% 


12% 


5% 


3% 


12% 


Language 


z 


40% 


51% 


1% 


3% 


1% 


3% 


1% 


Arts 


6 


35% 


49% 


7% 


6% 


2% 


1% 


1% 




10 


26% 


38% 


2% 


12% 


2% 


0% 


19% 



Table 1 11-10 



Percent of Students by the Total Hours of Title I Instruction 
Received Dur1n<) the Regular School Year 



Subject 


Grade 






Total 


Hours 










Less than 


40.x - 


60.1 - 


80.1 - 


100.1 - 


over 






40.1 


60.0 


80.0 


100.0 


120.0 


120.0 


Read1n9 


Z 


6% 


9% 


21% 


23% 


15% 


27% 




6 


5% 


6% 


18% 


18% 


18% 


44% 




10 


3% 


2% 


13% 


12% 


m 


50% 


Math 


z 


8% 


12% 


20% 


19% 


13% 


28% 




6 


8% 


10% 


19% 


m 


12% 


33% 




10 


13% 


4% 


10% 


17% 


7% 


49% 


Lan9ua9e 


z 


7% 


7% 


20% 


27% 


5% 


34% 


Arts 


6 


9% 


18% 


20% 


13% 


5% 


36% 


10 


1% 


11% 


4% 


13% 


5% 


66% 



60 
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Table III-U 

Percent of Students by Hours Per Week of Instruction 



Subject Grade Hours Per Week of Instruction 







1.0 


1.1 - 2.0 


2.1 - 3.0 


3.1 - 4.0 


Ovef 4.0 


Reading 


2 


4% 


16% 


41% 


24% 


16% 




6 


3% 


14% 


33% 


29% 


20% 




10 


2X 


8% 


28% 


25% 


37% 


Nath 


2 


5% 


19% 


36% 


21% 


18% 




6 


4X 


20% 


32% 


24% 


21% 




10 


6% 


16% 


19% 


22% 


37% 


Language 


2 


1% 


16% 


43% 


12% 


28% 


Arts 


6 


OX 


28% 


27% 


15% 


29% 




10 


1% 


11% 


12% 


29^ 


47% 



Table 1 1 1-12 



Percent of Students by Student to Teacher Ratio In Title I 
Projects During the Regular School Year 



Subject 


Grade 






Student to Teacher Ratio 












l.l - 


Z.l - 


- 


6.1 - 


iU.i - 


Over 








2.0 


4.0 


6.0 


10.0 


15.0 


15.0 


Readi ng 


2 


12% 


5% 


24% 


31% 


20% 


6% 


3% 


6 


11% 


4% 


19% 


26% 


26% 


10% 


5% 




10 


6% 


2% 


19% 


16% 


30% 


14% 


13% 


Hath 


2 


15% 


5% 


23% 


22% 


20% 


9% 


4% 




6 


14% 


3% 


18% 


23% 


24% 


10% 


7% 




10 


7% 


2% 


19% 


18% 


28% 


23% 


3% 


Language 


2 


12% 


5% 


20% 


18% 


22% 


7% 


16% 


Arts 


6 


15% 


3% 


21% 


17% 


18% 


10% 


17% 


10 


3% 


3% 


8% 


14% 


40% 


29% 


4% 
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that the typical student received during the year. Tables Ill-lO and 
III-U present this Informtlon. 

The t»lca1 second grade student receives 2.1 - 3.0 hours per weeic 
of THie I Instruction regardless of the subject area. The typical 6th 
grade student receives slightly more Title I Instruction per week, and 
the typical 10th grade student receives the most Instruction per week 
•-over 4.Q hours—In reading, math or language arts. The typical 10th 
grade student also tends to receive more hours of Instruction during the 
project, with 51t of the reading students, 49% of the mth students, and 
6GX of the language arts students receiving over 120 hours of Instruction 
during the project. 

Student to Tmcher Ratio 

Title I students tend to be served In stnaTI groups. (See Table 
lH-12.) Approximately 75t - 90% of the elementary school students In 
grades 2 and 6 are served In settings where the student to teacher 
ratio Is 10:1 or less. About 70t of the grade 10 students are terved 
In project settings with a similar student to teacher ratio. Relatively 
few studentS"3% - 13t»are served In settings where the student to 
teacher ratio Is over 15:1. 



Summer Term Activities 

SEAs were requested to submit Information on the nunA>er ^^f students 
served by grade level and publlc/nonpubllc designation, the number of 
students served by service area, student ethnic group counts, and the 
nunber of staff employed by job classification for the summer term of 
1980. The summer term was defined to be that period of time directly 
following the regular school year of l979-d0. Information on summer 
school programs was less complete than Information on the regular school 
year and In mny cases the nunbers should be considered lower bounds. 
Eight SEAs did not report on summer term activities. Three stated that 
there were no summer p.ograms, one stated that the summer program was 
very limited and no Information was available, and it was unclear from 
the reporting forms submitted by the other four SEAs whether or not 
there were summer programs. 



Number of Participants 

Based on the Information received (see Table III-13), over 314,000 
students participated In Title I programs during the sunmer. Nearly 
12,000 of these students were In nonpublic schools. The majority, 71t, 
were In grades 1 to 6; only 4t were 1n grades 9 to 12. Of these students, 
6139 were in local Institutions for the neglected or delinquent In 24 
SEAs. 
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Types of Services Provided 

Table 111-14 provides Information on participation by service area. 
A ma jorlty of the students received Instruction In reading (6eX) or 
nthemtlcs (63%). Only five SEAs reported providing vocational ser- 
vices, and only five reported providing special services for the handl- 

G2 
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Table III-13 

Nunber of Title I Participants Duping the Summer Term In 
1979-80 by Grade Level and Public-Konpubllc Designation^^ 



Grade 


Public 




Nonpublic 




Total 




Number 




Number ( %) 


Number [ X] 


Preklndergarten 


7.241 


t 3) 


210 { 2) 


7.451 ( 


: 2) 


Kindergarten 


14,818 


{ 5) 


1.858 


[15 


16.676 1 




I 


46.523 


(16) 


1.488 


12) 


48.011 1 


\d\ 


2 


51.682 


(18) 


1.568 


!l3) 


53,250 


!l8) 


3 


47.922 


!nl 


1.620 




49.54*: 




4 


32.326 




1.478 




33.804 




5 


28.640 




1.244 


|io) 


29.884 


iio) 


6 


21.677 


h 


1.034 1 




22.711 1 




7 


14.594 




469 


i 


15.063 




f 


9.268 


( 3) 


395 ( 




9.663 


I 3) 


9 


6.491 


222 




6.713 




10 


3.680 


jjj 


238 




3.918 




11 


2.326 




148 




2.474 


( 1) 


12 


1.232 


(") 


36 (-) 


1.268 


(") 


Total 


288.420 


(100) 


12.008 (100) 


300.428 (100) 


Total including 


301.422 




12.816 




314.252 





all ungraded and N or D 



12 



Data ar« Incomplete due to incomplete reporting* 
are probably higher* 



The actual numbers 



of THto I PMicipmto by Oracto 1970*19^ 

T«rm 



in 




erJc 



Flour* Ul-fl. Percent of participints by gritfe level during the smner 
ten of 1979-80. 

83 
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Table IIM4 

Title I Participation by Service Area for the 19/9-80 Summer School Term 



Service Area 



Type o f PartlctpaTTon 
Public N' onoujllc ^o^^} ^ ^^Jj 

Number 1. %) Runoer [ %) Wumber [ it) 



Nunfcer f i) 



Instructional 
Limited English 
Read*! ng 
Language Arts 
Kathenatics 
Vocational 



15) 

v.\ 

special for Handicapped 382 ( — ) 
Other 85.142 (29) 



45»370 (15) 
194»018 (66) 
44»086 
189»616 

955 



Supporting 

Attendance* etc, 71»688 

Health, nutrition 44»737 

Transportation 90»559 

Other 68»899 



24) 
15) 
31) 
23) 



173 
9»170 
1»484 
6»204 
29 
15 
1»958 



894 
2»156 
5»352 

279 



( 1) 24 (--) 

(72) 4»581 (75) 



(12) 
'48) 

::i 

(15) 



(42) 
( 2) 



24 
4»581 
780 
3.114 
118 
0 

832 



656 



131 

i 
.--) 

(14) 



Total Number Served 295»303l3 12»816 



11) 
301 { 5) 
250 (12) 
344 ( 6) 

6»139 



45.567 (X5) 
208,768 (66) 
46.350 (X5 
198.934 (63 
1.1 02 
397 
87.932 (28) 



73.237 (23) 
47.194 (X5) 
95.683 (30) 
69.522 (22) 

314.252 



This number is an est ice obtained by subtracting all local Neglected 
or Delinquent participants from the total number of Public partici- 
pants. Since some local Neglected or Delinquent participants may be 
in Nonpublic institutions, the number is an underestimate. For the 
same reason, thti number of Nonpubl'^c participants is an overestimate. 
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Figure 111-9. IkiBber of participants by service ansa during the X979-80 
Sumner school term. 64 
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Title 1 Staff 

Summer school Title I staff were classified in four categories: 
administrative staff* teachers* teacher aides» and other. Over 3U000 
FTE staff members (see Table III-8) were employed In Title 1 projects^ 
or rouqhiy one for every 10 Title I participants* The majority of the 
staff menAers^ B4 percent^ were teachers or teacher aides. 



Table III-U 

Number of Staff Members Employed in Title I Projects 
L)ur1ng the Summer Term of 1979-80 



Job Classification Full-Tlme Equivalents ( %) 



Administrative Staff 


UZ14.5 


( 4) 


Teachers 


18»612.6 


(59) 


Teacher Aides 


7»99Z.4 


Other 


3»738.5 




Total 







Number of staff EmployMl in Title t Protects 
During the Summer Term of 1979-80 
in r 'tl>Time Equivalents 



Administrative 

(*ti«) 




Figure UI-IO. Title 1 project staff during the sunmer term of 1979-80. 



CHAPTER IV 

STUDENT ACHIEVEMENT 

Chapter IV contains Infornatlon on the academic achievement of 
students In Title I programs. Indudt..^: 

0 Information on "short-term" (I.e. either Mithin a school year 
or at most spanning one calendar year) achievement growth as 
measured by both six month (fa11-to-$pr1ng) and 12 month (typically 
spring-to-spring) testing cycles. 

0 Information on "long-term" (I.e. spanning more than one full year) 
achievement growth patterns. Including measures over three 
years for students who continued In Title I during that time 
as well as those who "graduated out" of the program, and 

0 Factors reUted to school year achievement. 

Additional analyses are being undertaken in EO and will be 
reported at a later date. In particular, project level Information 
collected through the Title I Evaluation and Reporting System Is currently 
being analyzed. The results for projects within each State wlU be pro- 
vided directly to the States for them to share with their participating 
districts, and overall national analyses will be reported by the summer 
of 1982. 

Sources of Information 

Evidence about the effectiveness of Title I services comes primarily 
from two sources; reports from States based on local evaluation data 
and focuseu Federal studies of specific evaluation Issues. In particular, 
the Sustaining Effects Study. In addition, case study reports from 
State and local education agencies are Included In this chapter In order 
to exemplify how evaluations are Invlemented and used, and In order to 
highlight some national trends In these areas. 

Sustaining Effects Study 

The Sustaining Effects Study (SES) Is a major, six-year study of 
the Elementary and Secondary Education Act (P.L. 9S-561) Title I 
programs thai Is nearing coiv>1et1on. Authorized by Section ISl (now 
Section 183) of Title I (Which requires the Department to conduct 
Independent evaluations "which d&crlbe and measure the Impact of 
procirams ... assisted under this title*), the Sustaining Effects Study 
was desl9ned to dor.jMnt the following; (1) the characteristics of 
districts, schools, an^l students participating In Title I; (2) the 
nature of T1t*» I ser Ices provided to program participants; and (3) 
an analysis of the effectiveness of those services over several years 
of program participation. 

The Sustaining Effects Study represents the most comprehensive 
effort to date In attempting to docwient and analyze the nature and 
effects of compensatory education programs. Data were collected on 
all students In a nationally representative sawple of over 200 elemen- 
tary schools during the three year period from the fall of 1975 through 
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the spring of 1978, Hot only were data collected on the characteristics of 
students* teachers and principals* on student progress In the basic skills* 
and on attitudes toward school* but Interviews were conducted with the 
parents of a representative sub-sample of 15*000 students. Information 
on the patterns of student achievement over a one-year period and over three 
years Is now available. 

Title I Evaluation and Reporting SYstem 

The 1979-80 school year marked the first year In which all States 
participated in the Title I Evaluation and Reporting System (TIERS)* the 
system of models and reporting forms designed to yield aggregatable* 
nationwide information about Title I participation and effects. 
Reports were received from all of the States by the late summer of 
1981. In addition to the participation and staffing information presented 
in Chapter III* the reports included achievement Information on students 
participating In reading* mathematics* and language arts programs In 
grades 2 t^rough 12. 

States had the option of reporting data from all of their local 
education agencies (LEAs) or from a sample of one-third of their LEAs. 
Twenty States reported on a sample of their LEAs* and their test data 
were subsequently weighted for the national data analyses. For each 
grade* test cycle and subject* the States reported the following 
information: membership (the number of children enrolled in the 
Title I project on a given day)* the nunber of students with pretest 
and posttest scores* the wei^ted average posttest score* and the weighted 
average gain, in addition to this aggregate information* States provided 
project-level information for grades 2* 6 and 10. Project-level information 
included an LEA identification code* a descriptor of the type of project* 
subject area* evaluation model used* test interval* hours per week of 
instruction* total nuirber of hours of project instruction* student-lnstrjctor 
ratio* membership* number of students with pre- and posttest scores* a post- 
test Identification code* the mean posttest Normal Curve Equivalent (NCE) 
score and the mean NCE galn.^ 

The TIERS State aggregate data must be viewed at this stage with some 
caution* since these data: (1) are based on scores aggregated across 
tinny different tests* of varying quality and appropriateness* and admin- 
istered under locally controlled conditions^ (2) in some situations data 
were obtained in States or districts implementing new evaluation proce- 
dures for the first timej and (3) in some situations quality control 
procedures may not have been adequately implemented. While these parti- 
cular problems are not features of the Sustaining Effects Study* it is 
nevertheless the case that sometimes the TIERS data may prove niore valid 
than the Sustaining Effects Study Data* since local control over test 
selection may account for a better match between the test and the 
instructional objectives of the Title I programs. 



1 Test scores were reported In Normal Curve Equivalent Units (NCEs). 
The NCE Is a standard score metric with a mean of 50 and a standard 
deviation of 21.06. The use of a standard score metric allows 
arithmetical computations. of the dtA which would not be possible 
with percentiles, for tHti *iepoyt;;data will genetaTly be reported 
In percentiles in order to ease interpretation. " . * 
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Achievement data were collected from all SEAs; however, this report 
summarizes only data from the 50 States plus the District of Columbia* 
The Insular territories reported conditions dissimilar to the other 
SEAs (e^go lack of availability of suitable tests and norms* testing In 
languages other than English), so their data were not aggregated with that 
of the other SEAs since they were not thought to be comparable* 

The primary focus of this report will be on the State level data from 
the TIERS and on Information from the Sustaining Effects Study* The TIERS 
project level information* as mentioned previously. Is still being analyzed* 

Short-term Achievement Impact 



Short-term achievement Impact, 1*e*, Information on achievement 
over one year or less, Is available both from the SES and from the TIERS* 
Information over both a full year and over the six months typical of a 
fall-to-spring evaluation are available from both sources* Overall, 
It was found that compensatory services, particularly Title I services^ 
often have positive Wyts on achievement * Different patterns of achieve- 
ment were found for different groups, however* In addition. Information 
from the TIERS shows that students tested on an annual testing schedule 
consistently shoired much smaller gains than those tested fa11-to*spring* 

A comparison of compensatory education (CE) students In grades 1^6 
with educationally needy non-CE groups, where the comparison groups have 
similar pretest achievement levels as the CE students (SES, 1982)» shows that; 

0 Compensatory education students gained more than similarly needy 
students who did not receive services in grades 1, 2 and 3 In 
reading and in grades 1 through 6 in mathematics, though they did 
not gain significantly more In grades 4 - 6 In reading* (The 
SES examined only grades 1-6, while the TIERS provides infor* 
mation spanning grades 2 - 12)* 

0 Positive effects of compensatory eduation are tound most often 
for students who participate in Title I (sometimes in combination 
with other compensatory services), as compared to those o n l/ 
served by other (e*g* State or local) compensatory education 
programs* 

0 Uhlle the achievement levels of Title I students are often raised, 
the benefits of CE are generally not great enough for Its parti- 
cipants to "catch up** with non -disadvantaged non-CE students* 

Some differences were found between the results of the SES and 
the TIERS » however* For example: 

0 The SES found ^sitive compensatory educatlor effects more 

frequently in grades 1 and 2, while the HERS found more positive 
effects isi grades 5 and 6* 

0 The SES and the fall-to-spring TIERS data show that the Impacts 
of CE on achievment groHrth are more noticeable In math than 
in reading, whereas the annual TIERS data show similar results 
for both reading and math; 
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As mentioned previously, 1979-80 was the first school year in which 
all States participated in the implementation of the Title I Evaluation 
and Reporting System (TIERS)» the system of models and repot^-lng forms 
d<BSiqnecl to yield dg{)reqatdble» nationwide Information about Title I 
participation and effects. Tables through lV-3 and Figures IV-1 
through lV-6 show the achievement level and gains of students Included 
in the evaluation of reading, mathematics* and language arts programs. 
In addition. Tables IV-4 through IV-7 present the range of values 
reported by States for reading and mathematics. 

In readinq, students tested on an annual testing .ycle showed 
mcdest positive qains at all grade levels except grades 10 and 12. 
The largest gain wai reported in grade 6» where the typical student 
moved from the ZZnd to the 27th percentile. Differences among the 
grades are smalU however, and should not be Interpreted to indicate 
actual differences in program effectiveness at different grade levels. 
(In fact» one would expect to see greater gains made at lower grade 1eveU» 
due to the ways in which tests are normed.) There was sreat variation 
among the States on the gains and pretest standing reported. The 
range of reported gain scores^ as expected* tends to decrease across 
grades, although considerable variation is found at all grades. 

Table IV-l 

Title I Reading Achievement Results (1979-80 TIERS) 



Annual Testing Fall-to-SprIng Testing"** 

Grade Percentile Percent Percentile Percent 





Pre- 


Post- 


NCE 


Additional 
Growth! 


pre- 


Post- 


NCE 


Additional 




test 


test 


Gain 


test 


test 


Ga^n 


Growth 


2 


28 


29 


1.0 


4 


18 


32 


9.4 


77 


3 


23 


26 


2.4 


17 


16 


26 


7.4 


90 


4 


23 


26 


1.9 


20 


16 


25 


7.0 


111 


5 


Z2 


26 


2.3 


32 


16 


25 


6.1 


132 


6 


22 


27 


3.2 


42 


17 


25 


6.0 


158 


7 


22 


25 


1.8 


27 


16 


23 


5.5 


1?^ 


8 


22 


25 


2.2 


;J1 


16 


22 


5.0 


113 


Q 


20 


22 


1.8 


38 


is 


22 


S.2 


163 


10 


17 


17 


-0.7 


'16 


16 


21 


4.2 


131 


11 


14 


12 


-2.2 


-43 


14 


18 


3.2 


123 


12 


12 




1.4 


53 


12 


17 


4.4 


133 



2 The t additional grovrth" measure represents the academic 
<] owth ftidde by compensatory education participants above and beyond 
tMt which would have been expected had they not received supple- 
mentary instruction. E.g., a percent additional growth measure of 
SOX indicates that the Title I students showed one and a half times 
as much academic gain as children comparable to them In Initial 
achieve-nent but who did not receive Titie I- These measpjres vary 
substantially from test to test (the figures here are based upon 
averages across the most commonly used tests in Title I) and should 
be interpreted with caution^ particularly at the upper grades. 
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In mathematics » students tested on an annual testing cycle showed 
modest Positive gains at all levels except grade 10. The largest gains 
were found In grade 6» where the typical ttudent mo\^d from the 24th to the 
31st percentile. The variability among States was even greater for 
mathematics than It was for reading. 

Table IV^2 

Title I Mathematics Achievement Results (1979-80 ilEI^} 



Annual Testing _ Fan-to-sprtofl. testing 



Grade 


Percentile 


NCE 
Gain 


Percent 
Additional 
Growth 


WJfcentne 


"fiafn 


Percent 
Additional 
Growth 


Pre- 
test 


FOSt- 
test 


Pre- 
test 


KOSC 

test 


2 


35 


37 


l.l 


5 


20 


36 


■ 10.5 


88 


3 


31 


32 


0.4 


0.2 


19 


32 


^ 8.6 


69 


4 


28 


30 


1.8 


15 


It 


31: 


9.0 


134 


S 


26 


30- 


2.5 


23 


18 


30- 


8.2 


115 


6 


24 


31 


3.9 


44 


18 


29 


7.7 


141 


7 


23 


26 


2.2 


29 


18 


27 


6.3 


150 


8 


23 


27 


2.8 


44 


17 


26 


6.2 


184 


9 


23 


24 


0.5 


10 


17 


25 


6.2 


200 


10 


21 


19 


-1.4 


-34 


20 


27 


5.3 


204 


11 


24 


24 


0.4 


11 , 


20 


29 


5.6 


311 


12 


22 


24 


1.0 


4d 


18 


, 27 


6.5 


■ '650 



In language arts» student tested on an annual testing cycle showed 
modest positive gains through grade 6» though It should be noted that 
relatively few students were tested In language arts. 

Table lV-3 

Title I English Language Arts Achievement Results (1979.80 TIER") 

Annual Testing Fal]-to-5irlng Testing 

Grade PercentMt Percent Percentile 1^. Percent 

Trf: WfT' HCE Additional Tr^ Toilf NtE Additional 
test test ^1n Growth t»»t test Gel'n . Growth 



2 


17 


19 


2.2 


10 


23 


34 


6.9 


64 


3 


18 


20 


1.9 


14 


20 


33 


8.0^ 


90 


4 


21 


22 


0.7 


17 


20 


31 


6.8. 


113 




15 


22 


1.5 


14 


22 


31- 


6.8' 


87 


0 


21 


24 


2:3 


45 


22 


32 


6; 7 


203 


7 


18 


■ 21 


' 2-3 


44**' ' 






^*5,2 


179 


8 


16 


20 


2.8 


43 


18' 


22 


3.4 


85 


9 


15 


15 


0.4 


13 


17 


23 


4.7 


235 


10 


14 


12 


-1.4 


-27 


15 


21 


4.5 


127 


11 


12 


10 


-2.6 


-48 


14 


19 


3.6 


109 


12 


10 


10 


-0.6 


-22 


14 


18 


3.2 


160 



70 
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Fi-unft IV-1. Reading achievement results for students tested on an 
annual cycle In 1979-80 (TIERS). 
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RMdifng echlevewent results for students tested on a fall 
to-spring cycle In 1979-80 (TIERS). 
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Figure IV-3. Mathematics achievement results for students tested on an 
annual cycle In 1979-80 (TIERS). 
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Figure IV-4. MathcR-Lics achievement results for students tested on a 
fall-to-spring cycle in 1979-80 (TIERS;. 
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1979-80 TITLE I PERFORMANCE REPORTS 
Full-Year 
English Uinguag« Arta Results 
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Figure lV-5* English language arts achievement -esults for students 
tested on an annual cycle (1979-80)* 
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Figure IV-6* English language arts achievement results for students 
tested on a fall-to-spring cycle in 1979-80 (TIERS). 
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Table IV-4 

1979-80 TUIe I Anmal Reading Achlevemnt Results For 
All State Education Agencies WUh at Least 100 Studertts Tested 



Grade Nund>er Percentile Normal Curve 

of Equivalent Gain 

States Pretest Postest 

Hin Median >ttx H^n Median TSx" "HTTHedlan Wax 



2 


34 


9 


24 


50 


15 


32 


55 


-3.9 


3.1 


12.6 


3 


31 


6 


21 


41 


12 


25 


45 


-1.0 


2.6 


13.0 


4 


33 


11 


20 


39 


15 


23 


43 


-2.5 


2.7 


8.2 


5 


32 


9 


18 


40 


11 


23 


44 


-0.1 


3.2 


9.2 




33 


9 


19 


39 


13 


24 


43 


-0.7 


3.4 


6.7 


7 


26 


7 


17 


43 


6 


20 


45 


-4.5 


2.0 


6.0 


8 


23 


10 


15 


40 


12 


1/ 


44 


-2.8 


2.2 


5.5 


9 


15 


9 


17 


37 


6 


20 


43 


-8.2 


2.5 


4.8 


10 


10 


7 


16 


39 


6 


12 


42 


-5.6 


0.2 


3.3 


11 


8 


6 


12 


24 


3 


11 


26 


-5.3 


0.8 


3.7 


12 


8 


5 


10 


28 


5 


13 


28 


-4.2 


2.3 


4.8 



Table IV-& 



1979-80 Title I F«ll-to-SDr1ng Reading Achievement Results for All 
State Education /.jencles With at Least 100 Students Tested 



Grade Hunnber Percentile Norml Curve 



of Equivalent Gain 

States Pretest Posttest 

Wrfedian fhx Wn Median fhx Hln He'fian Kix 



2 


51 


6 


19 


35 


12 


33 


49 


0.0 


8.9 


16.0 


3 


50 


5 


16 


28 


13 


27 


40 


2.6 


7.6 


13.0 


4 


49 


5 


16 


27 


12 


26 


40 


1.1 


7.1 


12.1 


5 


48 


6 


17 


31 


7 


25 


39 


-1.5 


6.2 


11.8 


6 


50 


6 


16 


26 


5 


24 


38 


-1.9 


5.9 


11.1 


7 


47 


6 


15 


27 


10 


24 


44 


2.9 


5.8 


9.9 


6 


46 


5 


15 


26 


7 


22 


33 


2.4 


6.6 


n.i 


9 


39 


7 


14 


22 


9 


21 


33 


3.1 


^.I 


11.3 


10 


35 


6 


IS 


28 


fO 


21 


3/ 


-I.? 


4.7 


n// 


11 


ZA 


3 


12 


21 


5 


16 


30 








12 


12 


4 


13 


23 


6 


17 


34 


0.0 


4.1 


/.O 
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Table IV-6 

1979-C3 Title I Annual Mathematics Achievement Results 
For All State Education Agencies With at Least 100 Students Tested 



Percentile Normal Curve 

Grade Nunber Equivalent Gain 
of Pretest Pgsttest 

States Hin Hedlan Nax Win Hedlan H>x Min nedlan Max 



2 


23 


12 


27 


48 


18 


34 


46 


-3.2 


3.8 


10.5 


3 


26 


9 


24 


50 


15 


30 


53 


-3.0 


3.4 


18.6 


4 


31 


9 


21 


49 


15 


27 


53 


-8.4 


4.2 


1S.7 


5 


30 


8 


21 


49 


12 


26 


62 


-1.5 


3.5 


14.8 


6 


29 


9 


20 


43 


16 


26 


50 


1.1 


4.4 


10.1 


7 


23 


8 


20 


39 


11 


2^ 


52 


-0.9 


2.9 


7.9 


8 


22 


9 


21 


44 


14 


24 


43 


-5.0 


2.8 


7.5 


9 


13 


9 


17 


46 


11 


20 


49 


-6.3 


1.5 


8.7 


10 


7 


9 


11 


52 


8 


14 


47 


-5.6 


-1.2 


5.9 


11 


6 


7 


11 


49 


11 


13 


45 


-1.9 


1.5 


7.2 


12 


6 


8 


14 


51 


7 


18 


43 


-4.4 


2.4 


5.9 



Table IV-7 

1979-80 Title I Fall-to-Sprlng Mathemtlcs Achievement Results 
For All State Education Agencies With at Least lOO Students Tested 



Percentile Nonrnl Curve 

Grade Nunber Equivalent Gain 
of Pretest Posttest 



States Min Median Hair Hin Hedlan M>x Min Median Hex 



2 


44 


5 


19 


30 


8 


35 


51 


2.6 


10.3 


23.5 


3 


45 


3 


19 


28 


5 


30 


46 


1.5 


8.4 


15.1 


4 


43 


6 


18 


28 


12 


30 


46 


2.6 


9.5 


18.0 


5 


44 


5 


18 


28 . 


. 8 


29 


45 


2.8 


8.3 


15.5 


6 


46 


5 


17 


37 


8 


28 


% 


2.0 


7.6 


14.0 


7 


41 


3 


17 


26 


10 


28 


43 


2.1 


6.2 


15.2 


8 


37 


4 


16 


28 


11 


26 


38 


1.0 


6.3 


18.4 


y 


25 


8 


16 


22 


14 


^2 


37 


2.0 


6.1 


10.6 


10 


17 


11 


19 


32 


14 


^ 


39 


-0.1 


4.7 


10.3 


11 


7 


7 


22 


28 


12 


33 


36 


2.3 


5.0 


8.4 


12 


4 


13 


21 


31 


20 


31 


38 


0.2 


5.2 


7.9 
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Test Cycle Effects in the TIERS 

Different patterns of results were found for students tested on a 
f^l Nto-spring schedule (typically October to April) and for those tested 
0}} ^n annual schedule (typically April to April). The gains for students 
tested annually are uniformly lower than the gains for students tested 
fall*to-spring. However^ the posttest scores show a tendency to be similar 
fcr the two groups; therefore^ the difference lies in the fact that the 
pretest scores tend to be lower for the fiV -to-sprinq group. 

The differences in annual and fall-to-spring test results have 
been noted in numerous state and local evaluations* Some of the reasons 
postulated include the following: students forget what they have 
learned over the summer^ different student populations are tested 
annually as opposed to fal l-to-spring» a greater proportion of program 
participants are included in the fall-to-spring evaluations^ students 
are more likely to have changed test levels in the annual evaluations* 
and annual testing programs are likely to have greater accountability 
since they serve general district purposes as well as Title I purposes- 
While some of these possible explanations can be discounted* others 
may have some validity. 

The results obtained from the annual testing cycle evaluations 
more closely rtsemble the results obtained In the Sustaining Effects 
S':udy than do the results of the f^l1*to-spring evaluations* As 
mentioned above* the reasons for the differences between the annual and 
the fall*to*spr1n* results are not fully understood at this time. One 
source of Information will be the studies conducted by districts to see 
if their project qalns are sustained over time* A limited amount of 
this Information Is provided In Chapter V in the section on Sustained 
Effects- While districts are required to coiiduct these studies* they 
are not required to report the results to EO or to their SEAs. Thus* 
while ma^^^ districts are willing to share their Information with EO* 
there is always the problem that the volunteers may not be representative 
of the whole group* 

Longitudinal Effects of Title I 

The SES contains information on Title I students in grades 1-6 over 
three years* during which time students participated in various combinations 
of Title I and regular programs. Figure IV-7 presents achievement 
information for four groups of students: 

0 Regular students who did not need and did not participate in 
Title I* 

0 Title I participants in Year 1 who 'graduated out' of Title I 
in Year 2 and stayed out* 

0 Title I participants in Years 1 and 2 who 'graduated out' of 
Title I in Year 3* 

0 Title I Participants who participated in the program for all 
three years- 
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The dotted line segments in Figure IV-8 indicate Title I partici* 
patlon across time. An examination of these lines shows '^hat: 

0 In reading^ Title I graduates do not generally fall back noticeably 
after participation ceases. 

0 In math» there generally Is a decline after participation ceases. 

Three year participants do not show Improventent over the three years> which 
Is to be expected had they showed substantial 1niprovement» they would have 
been graduated out of the program* This does Indicate* however* that some 
students will not show gains even after multiple years of compensatory educati 

In summary* it appears that Title I has some sustained benefits for 
program participants* particularly In reading* but that some students* par- 
ticularly In math* regress when Title I support is removed* (Growth In 
practical skills was found not to benefit from participation In CE programs* 
and the relationships between attitudes and participation are unclear*] 

These results contradict somewhat some of the previous findings* and 
they confirm others* In particular* early reports from the StS (Interim 
Report* 1980 and Report U* 1981) compared the achievement levels of 
regular students* Title I ^graduates*' continuing Title I students* 
and students who were no longer In the program because o^ promotion to 
a grade with no services or because the school lost funding* The 
Title I 'graduates' were compared to those students whose services 
were continuous over two years* The growth rate of students who 
'grad\jated' was higher than the growth rate of students still receiving 
services* leading to the conclusion that termination of services ^id 
not result In students disastrously falling back to the level of 
continuing students* This Is a different situation* however* than when 
students are compared over time* 
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Figure IV-7* Effects of "graduation" from Title T on student achievement* 
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Factors ReUted to School Year Achiev€<nent 

The relationships between types of program services and the effects 
of compensatory education were consldereJ In the Sustaining Effects 
Study* In general » as reported earlier* compensatory services have 
positive Impacts on reading achievement at the first three grades (and 
possibly at grade s1x)» and on mathematics achievement at all six grades* 
ThesJ positive effects were noteC* primarily for programs funded at least In 
part by Title I* However* It has proven difficult to demonstrate that 
substantial* consistent relationships exist between project characteristics 
and educational achievement* As discussed below* some factors descriptive 
of programs and Instructional services were found to be statistically related 
to educational achievement* but In general these relationships seem weak* 
Due to the tenuousness of these relationships* further reflection on 
project Implementation at the local level Is strongly advised* The following 
findings are provided In the Sustaining Effects Study: 

0 The amounts of regular Instruction and tutor/Independent work 
have positive* but modest» effects on achievement growth* However* 
the amount of Instruction by special teachers fe*g* subject area 
specialists)* a1des» and assistants; or In very small groups (less 
than 7 students) does not often have detectable effects* though 
when It does . .e effects are generally negative* 

0 Students taught by more expenerjed teachers tend to attain 
greater growth In both reading and mathematics achievement* 
It was consistently found that the teaching experience of the 
regular staff was positively related to achievement* 

0 More frequent feedback to students regarding their academic 
p;'ogress sometimes helps them to achieve greater reading and 
mathematics growth* In some grades* the time teachers spend 
on planning and evaluation Is also positively related to 
vhe reading achievement growth of their children* 

0 Temporary disruptions In Instruction* such as that caused by 
Physical fights or violence* tends to hamper reading and 
mathematics achievement In grades four through six* though 
not In grades one through three* 



Other Evidence of Effectiveness 

Other studies also suggest that a fifteen year decline In educa* 
tlonal achievement Is beginning to reverse* particularly among low* 
achieving groups* For Instance: 

0 The National Assessment of Educational Progress has documented 
improvements In the educational status of minority group nine* 
year olds over the past four years and has also shown Improved 
achievement levels In Title I schools* At least partially* these 
achievemnt gains may be attributable to Increased attention 
to basic skills and to effective compensatory education programs* 
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0 In a sample of 16 rtew York City Community School Districts* 
under a new competency testing program that stressed reading 
comprehension* gains improved by 50% In comprehension and by 
16% ^n vocaDulary between 1980 and 1981. At the same time, 
citywide test scores as well as the Scholastic Aptitude Test 
results for New York State also exhibited gains, surpassing 
national averages for the first time In years. 

0 In tiach of the past two years, the typical pupil In Chicago 
Title I classes Improved In reading by at least 4 percentile 
points, as measured by standardized tests. Some of the 
schools did even better, with gains In some classes 67% higher 
than those of similar students in appropriate norm groups. 
In addition, 80% of the parents of these Title I children 
corKurred with Involved teachers and principals In endorsing 
the Title I projects. 

0 In New Jersey, Basic Skills Improvement (BSI) programs repre- 
sent compensatory education programs funded through con^ina- 
tlons of ESEA Title I, State c<»npensatory education, and 
school district ei torts. New Jersey reported that not only 
had the programs accelerated the acquisition of basic skills, 
but the acceleration was greater In 1980 than It has been 
since the State first began evaluating Its programs. In 
reading, BSI students In^roved their perfonnance from an 
average pretest mean at the 23rd percentile to a posttest 
mean at the 36th percentile. In mathematics, students moved 
fron; the 26th percentile at the beginning of the program to 
the 42nd percentile In the following spring. 
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CHAPTER V 



IMPLEMENTING AND USING EVALUATIONS AT THE STATE AND LOCAL LEVEL 

Since the Inception of Title I, evaluation of the effects of 
the proqram has been a requirement of the law. Evaluation and 
reporting of the evaluation results are required at all three 
levels of Title I program administration: Kcal, State and Federal* 
The goal of introducing and maintaining such evaluation requirements 
seems twofold: to improve evaluation practices at the local and State 
levels so that the information obtained can be used for program improve- 
ment, and to standardize evaluation and reporting practices so that a 
national picture of program effects might emerge* 

The purpose of this chapter is to document the processes and 
progress to date in accomplishing these two objectives of evaluation 
under ESEA Title I -- improvement of evaluation practice and educational 
services. To do that, a review of the evaluation requirements and goals 
and a discussion of ED*s efforts to accomplish these I5 presented. 
Following that, a set of case studies — developed in order to furnish 
a national overview In key areas of evaluation and program Improvement 
/"tivity -- is provided* 

The Development and Implementation of the Title I 
tvaluation and Reporting System 

Historically, State Educational Agency (SEA) Title I evaluation 
reports did not provide a satisfactory source of information regarding 
the national effectiveness of the Title I program. Differences in the 
style and substance of the reports. In the evaluation techniques and 
measi'res utilized, and In the types of participat. jn and achievement 
data reported virtually precluded the possibility of accurately syn- 
thesizing the disparate information Into a report describing the national 
program. Similarly, it was not clear whether local evaluations provided 
any information which could be of use In Identifying program strengths, 
weaknesses, or educational Impacts on participants. 

The problems of the lack of comparability and validity of the 
Title I data were addressed ir the enactment of Section VA of ESEA 
In 1974 (P*L* 93-380)* The 95th Congress further amended ESEA In 
the Education Amendments of 1978 (P.L* 95-561), which consolidated the 
previous ESEA legislation and more specifically defined SEA» local 
education agency (LEA) and Department of Education (ED) evaluation 
and reporting requirements in Section 183. The basic requirements of 
Section 151 were maintained in Section 183 as follows: 

"***(a) Independent Evaluations -- The Secretary shall provide for 
independent evaluations which describe and measure the Inpact of 
programs and projects assisted under this title. Such evaluations 
maty be provided by contract or other arrangements, and shall be 
made by competent and Independent persons*** 

"*.*(b) Evaluation Standards and Schedule — The Secretary shall 
(1) develop and publish standards for the evaluation of program 
or project effectiveness In achieving the objectives of this title, 
and (?) develop a schedule for conducting evaluations **. designed 
to ensiire that eval;jations are conducted in representative samples of 
the local educational agencies in any State each year*.* 
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"...(c) Jointly Sponsored Studies The Secretary shall consult 
with State and local educational agencies in order to Provide 
for jointly sponsored objective evaluation studies of Programs 
and projects assisted under this title within a State**. 

"***{d) Evaluation Models The Secretary shall provide to 
State educational agencies, models for evaluation of all programs 
conducted under this title*** which shall include uniform procedures 
and criteria to be utilized by local educational aqencies and 
State aqencies, as well as by the State educational agency in the 
evaluation of such programs.*. 

"***{e) Technical Assistance The Secretary shall provide such 
technical and other assistance as may be necessary to State 
educational agencies to enable them to assist local educatioiial 
agencies and State agencies In the development and application of 
a systematic evaluation of programs in accorcjoce with the models 
developed by the Secretary*** 

"***{^) Specification of Objective Criteria The models developed 
by the Secretary shall specify the objective criteria which shall 
be utilized in the ei^aluation of all programs and shall outline 
techniques *** and methodology *** for Producing data which are 
comparable on a statewide and nationwide basis*" 

In summary, It was determined that new requirements and procedures 
for Title I evaluation would be implemented iu order to provide system*^ 
atlc and valid Information on the effectiveness of the Title I program* 

Independent Evaluations 

Independent evaluations have traditionally provided the best infor- 
mation available pertaining to the scope and operations of the Title I 
program* Among the studies which have been used by Congress during 
oversight or reauthorization hearings, two have been particularly 
Influential: the National Institute of Education's "Compensatory 
Education Study*' and the Office of Planning, Budget and Evaluation's 
"Sustaining Effects Study," particularly the early volumes which 
dealt with the relationships ot academic achievement, poverty and 
the formula for allocating Title I grants* Both of these studies 
have been discussed extensively In this report* 

Other studies recently carried out by the Office of Planning, 
Budqet and Evaluation are also discussed as appropriate throughoiit this 
report* A list of the most releva«n (not exhaustive) of thei;e studies 
includes the fol lowing: 

0 a Study of District Title I Management Practices 

0 a Study of State Title I Management Practices 

0 AU:^rnat1ve Measures of Comparability 

0 Parental Involvement in Four Federal Programs (including Title I) 

0 a Study of the Local Use of Test and Evaluation Information 

0 5 Study of the Title I Migrant Education Program* 

In addition to these, smaller independent .efforts were designed and 
Implemented to provide support to EO, States and local districts In 
examining and implementing the Title t Evaluation and Reporting System* 



ERIC 



8,1 



V-3 

The Title I Evaluation and Reporting System (TIERS) 

In 1974» USOE (now ED) awarded a contract to begin the develop- 
ment of a system to be used by LEAs, SEAs and USOE for Title I 
evaluation ani reporting* RMC Research Corporation undertook the 
difficult (and controversial) task of developing a set of evaluation 
models* reporting forms and support documents and materials- During 
the course of this project* each SEA was visited (as were three LEAs 
within each State) to assess their current evaluation practices and 
to determine how disruptive a proposed system might be to SEAs and 
their LEAs* The combination of models* implementation requirements 
and reporting system* referred to as the Title I Evaluation and Reporting 
System* or more commonly as TIERS * had a slow development/implementation 
process* 

By the summer of 1976* the preliminary work on developing the 
ideas and implementation procedures behind each of the basic models 
had been completed (Bessey* kosen* Chiang & Tallmadge* 1976(a)*(b); 
Tallmadge & Wood* 1976) and relatively widely disseminated yet* 
at the time of passage of the Education Amendments of 1978* p»L* 95- 
561* the RMC*USOE models and reporting system had still not been imple** 
mented nationwide* From the beginning* the development of the models 
and reporting system had spawned intense debates on technical and 
procedural issues* 

Until recently* these debates have continued or r?surlaced with 
predictable regularity; presently* however* the TTERS has not only 
been iTiPlemented nationally* but the system is accornpanied with general 
satisfaction* seems notable that so much criticism arose in 
opposition to a system designed to provide uniform evaluative 
information* the lack of which had generated so much criticism prior 
to 1974* (For a more thorough treatment of the checkered history of 
Title I evaluation consult McLaughlin* 1977; Rossi et al** 1977; Wisler 
and Anderson* 1979 or Stonehill and Groves* 1982)* 

There were numerous constraints placed on the models clue both 
to the nature of the Title I program and to the requirement t^t all 
LEAs would be required to submit evaluation reports* The first 
constraint wes that since the Title I program was designed to serve 
the educationally neediest children within eligible districts Und 
90% of all districts actually did receive Title I funds)* most standard 
experimental designs calling for a conrtparison group of similar* but 
unserved students* were inq)ossible — if not actually illegal to 
implement* 

A second constraint was that the majority of districts were small* 
and did not have experienced evaluators or the resources to purchase 
evaluation services* Thus* any evaluation and reporting system would 
have to be relatively easy for district personnel to understand and 
to implement and would need to be restricted in the amount of information 
included* Third* ;:he data collected from districts would have to be 
easily agqregatable by SEAs* in order to allow for a cohesive Federal 
report* 

Based on a review of evaluation efforts already underway in all 
SCAs and in many LEAs, on a synthesis of aspects of those efforts, and 
on other technical considerations* Title I evaluation system was 
O developed that consisted of the following key elements: 
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LRAs carry out evaluations of their projects (according to a 
schedule developed by the and concurred with by ED) using 
one of the published evaluation modals, or an acceptable alter- 
native. 

0 The LEA evaluation results are forwarded to their respective SEA* 
In turn, each SEA summarizes the results of their local ly-crnducted 
evaluations and reports biennially to ED. 

0 ED staff review the State results and analyze the dcta to produce 
national level info'^mation summarizinq participation, staffing, 
services, training and educational impact. 

Thus, the TIERS is used by ED to provide national information about 
the operation and effectiveness of the Title I program based on data 
originally provided by LEAs. The TIERS has been formally in place or.ly 
since the late fall of the 1979-80 school year, when on October 12, 1979, 
EU published regulations governing the evaljation process for LEAs 
and SEAS, including specific mrdels to be usee* in examining the effective- 
ness of projects that provide compensatory instruction in grades 2 - 12, 
for reading, mathematics or language arts* In fact, all of the SEAs had 
begun implementing the TIERS models, even though they were not yet formally 
required at the beginning of the 1979-80 school year* The regulation^ 
describe the following components of TIERS; 

Tec hnical standards . In their application to the SEA for their 
Title 1 grant, er^ch LEA must describe how its evaluation procedures 
will be desigiV^d con<^''cted so as to be as accurate as possible* 
The areas that LEAs must consider artd describe 1n their applications 
include the following; (1) application of evaluation Procedures that 
assur that participants in the evaluations and the results obtained 
are representative of those children who receive Title I services; 
(2) selection of appropriate measurement instruments; (3) use of procedures 
that minimize errors (e.g* in icoring, analysis, test administration, 
etc.); and, (4) the use of ai evaluation model that yields a valid 
?*^sessment of achievement growth in the basic skills area> for which 
ccMTipensatory education has been provided. 

The evaluation models * In order to provide achievement test 
information that can be aggregated at the LEA, SEA and national levels 
and yet still provide scwne flexibility in selecting instruments that 
reflect instructional objectives of the LEAs, a set of models and 
implementation procedures has been developed and published as part of 
the Title 1 evaluation regulations* Provisions also exist for the 
development and approval of alternative mode given that they satisfy 
the information needs of the SEA and ED* 

Reporting requirements . Requirements for the periodic reporting 
of Titf^ r 1 nformation. Including participtition and evaluation data, 
are provided for SEAs, LEAs and ED. Currently, LEAs and SEAs report 
annually on the descriptive information collected in che TIERS, and 
biennially on the evaluation impact information {though each report 
summarizes the evaluations of the previous two years)* 
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Allowble cQsts # The .regulations specifically describe which evalua- 
tion activities may be Implemented using Title I funds, and which may net* 



Su pporting materials * To accompany TIERS» EO has developed and 
Publislied or ntherwls^ disseminated materials and documents designed to 
help Title I eva*«uators understand tue evaluation requirements and the 
ways in which the TIERS can best be implemented* Among th^se materials 
are the following: (I) The Title I Evaluation Policy Manual s required by 
Congress^ Is an interpretive supplement to the evaluation regulations; 
(2) the User's Guide is a how-to-do-lt volume desrribing the technical 
features nf the TIERS models and the implementation procedures that can 
be u5ed; (3) the Evaluator's References ^ a volume of further reading 
about technical evaluation issues of general Information to TIERS Imple- 
mentors; anu (4) ^ series of technical Issues papers giving an In-depth 
presentation of selected evaluation issues* In addition to those documents 
already discussed, ED has published a series of monographs and technical 
pamphlets pertaining to Title I evaluation* Other reports Produced 
during the performance of Title I evaluation-related contract work are 
also available* 

R<>qu1rements under ECIA* The Education Consolidation and Improve* 
ment Act of 1981 will require districts to evaluate their Chapter I 
projects "in terms of their effectiveness in achieving the goals set for 
them» and that such evaluations shall Include objective n^asurements of 
educational achievement in the basic skills ^nd a determination of whether 
improved performance is sustained***" {Section 556» b» 4)* Districts 
may continue to use the evaluation and reporting system that is required 
by Title I to evaluate their Chapter I projects* No specific reporting 
and evaluation system will be required for Chapter I» however* 

Technical Assistance Centers 

In order to help SEAs and LEAs improve their evaluation capabilities 
and to impienK>ot the reguirements of TIERS, ten regional Technical 
Assistavice i^»»-ers (TACs) were established* (See Figure V-l for a map 
of ths different regions and the Centers that se ve them*) The TACs have 
beeo in operation since 1976» providing consulting services at no direct 
charge to SEAs and LEAs* Starting with an emphasis on training Title I 
administrators and evaluators tn basic evaluation concepts and on imple^ 
menting the TIERS models* tht TACs have expanded their operations to 
include the provision of services* at the request of SEAs and LEAs* in 
all ~^eas of evaluation* incluuing process evaluation and the use of 
evaluation to improve projects* 

The Title I Technical Assistance Centers (TACs) provide consulting 
services to State and local education agencies (SEAs and LEAs) that 
receive ESf Title I funds* The TACs operate at the direction of the 
SEAs and consult with a contact person appointed by the Chief State 
School Officer in each State to detetmine the needs of the State and 
local personnel* Emphasis is placed on providing services which are 
tailored to the needs of each State; this has resulted in differing 
delivery modes as well as assistance areas across the country* Con- 
sultations with the contact v^ersons are on-going and the TACs have been 
fley'ble enough to meet changing needs within regions* The primary 
objective of the Project is to provide training and improved capabilities 
for SEA and LEA personnel in evaluation and Program management* 
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The Technical Assistance Centers were originally funded (throuqh 
competitive procurement procedures) in the fall of 1976. The TACs 
were funded for 15 months with an optional 15 month extension* which 
was exercised In all cases* These contracts were extended for an 
additional 6 months to allow ^'^letion of an assessment of the 
technical assistance efforts .^re new competition* On September 30> 
1979» new contracts were signed for each of the 10 HEW regions of the 
country* with two option years possible* All options were exercised* 
and current funding wiH expire on September 30» 1982 *- Just as ECIA 
Chapter 1 will go into effect. Later Centers will operate differently, 
as appropriate* to help States and districts design their own efforts* 



VO(jr f^fjlon^l ESEA Title I Techntcrl A£,sf&tanc«^ ConTcr (TACJ 
aviittabfe to prcvide FREE tectinical assistonci? regarding tt^e 
eiafijallon of Title f programs lo local 4nci stale agencies. 




\ -"'^•^i'r _^-r"^v 




To f;«>d out mortt, call ycur TAC. 



R(q1on I; PMC Re^^arch Corporation (Portsmouth, NH) 
Region II: Educational Testing Services (Princeton, KJ) 
Reqion III: NTS Research Corporation (Durham, NC) 
Region IV; Educational Testing Services (Atlanta* 
Region V; Educational Testing Services (Evanston, 
Region VI; Powell Associates (Austin* TX) 
Region VII; American Instltuter, for Research (Palo Alto, 
Region VIII, IX» and X; Northwest Regional Educational 
Laboratory (Portland* OR) 



GA) 
IL) 



CA) 



Figure V-U The regional Technical Assistance Centers* 
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Ser V 1 ces P^o * The TACs Provide technfcal support and traifiinq 
to StAs" anrt LEAs that are evaluating the eff^fcts of their comp^jnsatory 
educ^itlonal proqrams* Specifically, through d cof?b1nat1on of onsUe and 
regional workshops anri consultations and through telephone contacts anri 
corresf>3ndence, the TACs; 

0 Assist SEAs and LEAs to plan and implement valid evaluations* 

0 Kelp SEAs and LEAs analyze and interpret the results of the 
evaluations they have conducted* 

0 Assist SbAs *d LEAs in the development of data management and 
quality control systems, particu arty with respect to testing, 
rtem-^^raphic and participation intormation* 

0 Develop materials that can be used in SEA anf! LEA-sponsored 
work!>hops or in a stand*a1one capacity, for such purposes as 
basic evaluation Instruction, program Improvement through eval* 
uation, training Parent Advisory Councils, and communicating the 
results of evaluations to parents and school boards* 

0 Assist SEAs and LEAs in more in-depth technical Investigations 
to improve or refine evaluation procedures and programs* The 
topics of a technical Investigation might include (but not be 
limited to) the following: reductioi of testing burden through 
mult pie uses of single Installments, 'level oprtient of strategies 
to measure the fidelity oV program iiTq)*ementat1on, development 
of personal cot<)uter softvare that can be used by small and 
medium-sized LEAs to manaje pupil school and evaluation records, 
and development of procedures to better communicate evaluation 
results* 

0 Sponsor periodic regional coordinating council meetings, at 
which representatives from all States within a regi* * can 
discuss their progress and problems, review and discuss new 
materials, and share their perceptions and ideas with ED 
program officers* 

The TACs are contractually forbidden to P^ ticipats in the 
following activities or to provide the following services: 

0 Representation or interpretation of State or Federal laws 
or policies* 

0 Provision of edvice regarding specific educational curricula* 

0 Endorsements 3f any specific tests ot instruments* 

0 Conducting evaluations or writing evaluation reports for SEA. 
and LEAs* 
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Table summarizes the amount of services the TACs have provided 
durint) the fir:.* two years of their current contriict per1;id# The fairly 
substantial variation In numbers of services and clients se/ved across 
the regions Is naturr1» reflecting many factors including geographic 
distance and population* A more thorough discussion and as$essmen- of 
TAC services *^i11 be forthcoming as ^ result of a current study of the 
entire Title I Evaluation and !!3port1ng System and technical assistance* 
The Executive Summary from this effort will be attached as an appendix 
to th'iS report* 

Table V-1 

Technical Assistance Center Activities from 
November 1979 through September 1981 
(23 months) 



Workshops and Consultations Number of Telephone Amount 

Conversations with Correspondence 

Region Number Clients 1 SEAs and lEAs with SEAs and lEAs 

I 1049 7^244 2^728 U855 

11 954 8^171 U322 4»60l 

III 664 7^973 2^160 U940 

IV 636 10^857 2^968 2^658 

V 377 10,027 1,481 1,709 

VI 524 10,2?6 2,468 1,785 

V!I 325 6,100 1,^08 866 

VIII 439 6,741 1,153 766 

IX 462 6,689 1,026 1,G04 

X 323 4,692 870 506 

Total 5,653 31,790 17,366 17,690 



Areas of work* The TACs operate, as mentioned earlier, at the 
reguests or stAs and LEAs* While In the past tne T/Cs have had as a 
priority the Implementation of the TIERS, recently the focus of the work 
of the TACs has shifted to the areas of Improving and using local and 
State evaiuatlons in order to foster the Improvement: of educational 
programs* To this end, the TACs have been requested to develop, sponsor 
or participate In tho fo^ owing actlvitl^'.s: 

0 Test Ipformatlon Cencer * located at the TAC In Evanston It» 
the Test information Center serves as 3 centralized and coor- 
dinated test Information resource for all TACs to use when 
provldinq test Information to their clients* The Center was 



^ This Is a duplicated count, since many of the same clients receive 
multiple services* 
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established In response to a major need Identified nationally 
for specific Information about the many tests being used across 
the country for Title I evaluat'^^n* A method was needed to 
provide this Information while avoiding duplication of TAC and 
test publishers' efforts* 

To n^et this need» the Test Information Center was begun In 
1978» and It serves as the communication link between test 
publishers and the TACs» and through the TACs to SEA and LEA 
staff around the country* The Certe* maintains frequent contact 
with test publishers who respond to ^ iqulrles concerning their 
tests* Information Is provided through written and telephone 
communications* onslte visits and workshop presentations* news- 
letters and special publications* 

The Center has been Influential In alerting SEA ^"^d LEA staff to 
the Importance of selecting appropr'^ate tests that match the 
content of their con^ensatory education programs* of choosing 
tests of appropriate difficulty* of administering them under 
proper conditions* of scoring and Interpreting them correctly* 
and In using test results for needs assessment and diagnosis 
appropriately* 

0 Evaluation Clearinghouse * Uc:*ted at the TAC In Palo Alto CA* 
the Clearinghouse contains computerized* Iceyworded* ind abstracted 
information on available Title I workshop materials and on research 
and evaluation studies* The Clearinghouse contains materials In 
various formats* Including formally published research cocuments* 
fnforHnal reports* In-service training packages* and audlovlsuals* 

The Clearinghouse uses state-of-the-art computer technology to 
manage these resources and to provide Instant access to them* 
It provides search and document delivery services to any Title I 
program requesting asj^lstance* and during the year ending 
September 30* 1981 provided over 3*000 documents upon request* 

All SEAs* many of the larger LEAs and Intermediate service units* 
all of the TACs* and EO have been provided access guides and 
Indices to Clearinghouse resource materials* The Clearinghouse 
Is reguUrly utilized by educators and evalua'cors representing 
a cross-£;ect1on of the national compensatory education community* 
Classroom teachers have used the Clearinghouse to locate materials 
for use with parents* SEAs frequently request Information for 
their Title I program or program evaluation departments* The 
TACs and EO have utilized the Clearinghouse extensively to support 
both training activities and research activities* 

Judging by the levels of voluntary requests for services that have 
been Initiated by SEAs and LEAs* the TACs have proved both popular and 
effective*"^ In 1978* a performance review and Independent evaluation of 
the TACs was conducted by the Assistant Secretary for Planning and Evaluation 
In HEW (Mlllman et a1 » 1979)* The evaluation results in general were 
quite positive* concluding that "The TACs are working and working well*** 
Nevertheless* suggestions made by the evaluation panel and published In 
the report were used as a basis for trying to Improve the efficiency of 
TAC operations As previously mentioned* the Executi/e Summary of a 
^ follow-up eviiluatlon of the TACs will be appended to this report* 

ERslC 
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Uter In this chapter, a discussion of SEA and LEA evaluation and 
program Improvement activities will be presented. In many ways» this 
work Is Inextricably linked with the services provided by the TACs* 
A brief Introduction to some of the major areas» each of which will be 
discussed later In more detail » follows: 

0 Proqrj ' m Improvement evaluation ♦ SEAs and LEAs have Increasingly 
requested services aimed at applying what they are learning 
through evaluation towards enhancing the ways In which 
It ^^'''uctlonal services are provided* Particular interest^ as 
mee^jred by Increasing demand for assistance In this area» Is In 
examining tl*a ways In which programs are actually Implemented* 
so as to assess whether program operations actually follow program 
designs* Other areas related to prograir Improvement stress 
better communication of evaluation results* better Information 
management* etc* 

A set of training modules Is under development In this area* 
The materials address the following: setting goals for programs* 
Identifying Instructional strategies* measuring the implementation 
of those strategies and communicating evaluation results. 

0 Improved testing procedures * The TACs stress the 1fl?>rove- 
ment of local evaluation methods* Including the proper selection 
of Instruments to match program objectives* selection of 
tests of appropr1<«te difficulty* adherence to technical standards* 
proper administration and scoring of tests* and appropriate 
analysis procedures to estimate the Impact of educational programs* 
Additionally* strategies tD reduce the testing burden for "^Itle I 
children are being examined* 

0 Mr eds assessment * The TACs have developed materials for use 
TrT Identifying and selecting children with special academic 
needs* Tne materials are available to train SEA and LEA 
personnel In using multiple measures to assess and diagnose 
the needs of law*ach^ev1ng children In order to better target 
educational services* 

0 Quality control systems * The TACs have helped develop both 
automatic and manual system? for reviewing the accuracy of 
evaluation and program^descrlptlve Infonnavlon* In some 3EAs* 
a computer-based system for score conversions ha'i been Imple- 
mented at the State level* resulting In substantial time and 
paperwork savings at the LEAs and In Increased precision 
in evaluating and reporting test results* Other systejri use 
a "planning calendar" moJ'il* In which LlAs review their eval- 
uation p-'oced^res at critical times during the year* following 
p. e-developed checklists* 

0 Sustained effects and summer drop-off * A persistent educational 
question involves *^ether students continue to grow academically 
aft !r special services are Interrupted or discontinued* The 
TA(^ have developed materials to enable SEAs and LEAs to address 
these queiftlons* TACs have aUo assisted SEAs and LEAs In 
examining the effe::ts of summer school Tlt^e I programs* 
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^ IdtftUying exemplary projects . SEAs» LEAs und ED have developed 
methois for identiTying» validating and disseminating information 
about projects thdt ^re exemplary in increasing the educational 
achievement of program participants # 

Funding 1 eveU For the period from October U 1980 to Septen*er 3D» 
198U the TACs were funded for approximately $8*3 million* From 
October 1981 through September ig82» TAC funding is approximately $8 
million* The role played by the TACs in assisting SEA and LEA program 
administrators and evaluators will continue to be appropriate when Chapter 
1 of ECIA takes effect for the 1982-83 school year* Before that date» 
ED plans to establish a new network of Technical Assistance Centers for 
Chapter 1 evaluation support* The new network will operate at a reduced 
funuliig TeveU currently estimated at between $4*2 - $5 million per year* 

Jointly Sponsored Studies 

In response to subsection 183(c) of ESEA Title I (which called for 
"*,*jointly sponsor^K* objective evaluation studies of programs and 
projects *****)» ED initiated a series oi competitive procurements 
limited to SEAs and tEAs in conjunction with their respective SErs* 
10 date» 29 of these "State Refinements to the ESEA Title I Evaludtior* 
and Reporting System" contracts have been awarded* 

The priniary purpose of these contracts has been to support develop- 
mental work in measurement and evaluation by SE.'*s» with a secondary goal 
that this work will increase the utility of their Title J evaluations 
for improving educational decisions and programs* All of the "State 
Refinements'* efforts were to result in the development of instructional 
and/or implementation aids to imprcve program evaluation* management or 
training activities in the originating State; however* the applicability 
of these materials for use in other States or at the national level was 
considered when making awards. 

Funded as a competitive procurement over ohe last three years* 
proposals were invited fr^ all 'yEAs* SEAs were encouraged to* and 
did* secure th«: active participation of their LEAs* SEAs also involved 
other educational organizations to some f'xtent* e*g* in*State universities* 
Educational Research and Development Centers* private firms* etc* In 
all cases* the co-sponsored '*State Refinement" activities represented 
work that would have been /irtuslly impossible to undertalce without the 
supplementary funding available through this competition* SEAs were also 
required to document their own "in»kind contributions" in order to guarantee 
that the efforts were* in facL^ jointly sponsored* 

Fourteen studies were sponsored in 1979* and these efforts ran be grouped 
into two main catgr>ries: (1) improvement of data ':o11ection and .analysis 
activities and {Z) projects related to improving testing and evaluation 
fnethods* , The first * ^tegory includes projects undertat;en by Pennsylvania 
(to determine the types of errors being made in Title 1 data collection 
and analysis and to develop materials to reduce the number and severity of 
these errors) »'hich resulted In the development and implementation of a 
computerized system for the conversion and analysis* at the SEA* of all 
local district test scores* Another approach to the same topic was u.ied 
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in Arkansas, which developed user-oriented instructional materials to 
reduce the numbers and types of errors usually made in local Title I 
evaluation ^nd reporting* Materials developed in Arkansas include three 
filmstrips, four aud^o tapes and a detailed pro<| rammed- text handbook and 
planning calendar for proper implementation of Title I evaluation procedures* 

In 1980, the second year of he *'State Refinements*' activity, ED 
added two additional categories for award* One focused on improving the 
utility of evaluation information at the LEA and SEA levels, and the 
second examined local management efficiency related to the adoption of 
the Title I evaluation models* For example, in the former category 
New York developed a ctwiputer-based feedback sys^^em for use in reporting 
Title I evaluation results back to the participating LEAs* This system 
was designed to be compatible with New York's extant individual student 
data system and can be used at the LEA to link formative and summatlve 
evaluation efforts by displaying student achievement against allocated 
instructional resources* 

The latter category involved efforts to investigate the actual opera- 
tions of Title I evaluations in order to improve the coordination of 
Title I evaluation with other district activities, e*g* a review and 
ar^lysis of how SEA or LEA testing programs could be coordinated with or 
adapted for SEA or ED infor-nation needs* For instance* working In this 
category, Wisconsin developed a framework of program characteristics 
such that evaluation data from similar LEAs can be used by those LEAs 
for comparative purposes* 

In 1981, a prograiwnatic decision was made by ED to fund fewer pro- 
jects, buc with the possibility of sponsoring activities with fairly 
ambitious goals and with a higher level of effort than was previoti<;ly 
allowed* Three awards were made in 1981* These ongoing efforts are as 
f ol 1 ows : 

0 The objective o^ California's project is to increase the use of 
evaluative infomatioa by the local projects* This objective 
will be achieved by developirtg a handbook and training workshop, 
in case study f'^rmat, to define problem areas related to compen- 
satory educatii .al programs and to provide suggested solutions 
for the^e problems based on the application of evaluation fi<^.ings* 

0 In Missouri, the SEA 'will docinnent and revise existing computer 
software and develop additionol programming, if necessary, which 
will enable the SEA to provide timely and con^irehensive feedback 
reports to its LEAs* The system will also be used to provide 
summary reports for the SEA and for ED and to provide technical 
analysis rep '^ts for the SEA and the LEAs* 

0 The goals of the Utah "State Refinement" project are to: (1) examine 
the relationships betweer standardized test scores and the ways in 
which the tests were administered* including an ana^ys^s of student 
test-taking skills* student motivation and item format; and (2) to 
institute better teacher and student training and motivation in 
order to improve the performance ot test-takers and to increase 
the validity of the resultant scores* 



Summary 

To surnmarize, the current status of Title I evaluation reflects seven 
years of work, dating from the 1974 Education Amendments. >e TIERS has 
been disseminated and pilot tesfed, with subsequent minor modifications, 
since 1976; for the first time In the 1979-80 school year, Implementation 
of a TIERS model was required of LEAs^ and SEAs were provided with uniform 
evaluation and reporting requirements to use in providing agqregata'^le 
impact and participation information to EO. For the first time since 
the inception of Title I, an evaluation and reporting system was put in 
place that had specific evaluation models to choose ifrom, standards for 
conducting the evaluation, a metric to allow aggregation across projects, 
and a systern of available expertise to provide the guidance necessary to 
make the system work. 

In 1978, both the House and the Senate noted in their respective 
Cormiittee Reports that the evaluation models should be reviewed. In the 
Notice of Proposed Rulemaking published in the Federal Register on 
February 7, 1979, EO first publicized the models and simultaneously 
statec^ its intention to comply with this mandate. As already mentioned, 
studies are now underway to examine the operation and satisfaction, at 
the FederaU State and local level, of the TIERS and its associated 
technical support systems (See appendix.) 

Evaluation and Program Improvement Activities - 
Some Case Studies 

To a typical educational practitioner prior to 1979» the terms "evalu- 
ation" and "reporting requirements" were virtually synonyi^ids. In many 
Stat'^ education agencies and particularly at the local project level, data 
collected for purposes of complying with mandated Federal reporting require- 
ments was deemed to be of little, if any» value or use in improvinq how local 
education programs were designed and implemented. Evaluation data were col- 
lected only because they were mandated by Federal law or regulation and an SEA 
or LEA had to comply in order to remain eligible for continued funding. 

At that time, little attention was paid to the quality and accuracy 
of the data, to whether appropriate measurement devices had been used» 
to how tests were administered, to whether scores were accurate, data 
analyzed properly or whether students were tested at their appropriate 
levels of test difficulty. Most State and local educators responsible 
for program management were naturally hesitant to incorporate such question- 
able information into any decisions they made about their programs. 

While TIERS is, in fact» a reporting system designed to provide 
evaluation information for national as well as State and local use, 
SEAs and LEAs began to recognize that the TIERS did also form a basis for 
operating valid and r*eliable student performance data for use in assessing 
the iinpact of their programs, in addition, the preamble to the Title I 
evaluation regulations asserted that the TIERS evaluation models^ by 
themselves, do not substitute for» but only add to» a complete evaluation 
of a Title I program's implementation, strengths and weaknesses* 

With help from the Title I TACs, SEAs and LEAs began the process of 
training Pers.^nnel in sound evaluation procedures^ modifying reporting 
forms and developing quality control procedures. Many of the problems 
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and frustrations that had pMgued these educators and had inhibited 
their use of evaluation information were removed by TIERS and TACs. 
Once confidence had been restored that accurate 1nfonnv:^on could be 
collected on Title I student performance and program impact* SEAs and 
LEAs were ready to take the next step. They realized that Impact data 
on whether a student or program succeeded or failed was not enough — in 
order to have a comprehensive program evaluation that would be useful to 
them* they needed to collect infomation on now key elements in the program 
had been implemented and how these elements could be modified in order 
to maximize the benefits to students. 

This process of getting SEAs and LEAs to regard evaluation as something 
they can actually use* and not just as a mandated reporting requirement* has 
been an evolutionary one. While every SEA and LEA 1s now implementing TIERS* 
and while it appears that progress has been made* there remains a great deal 
still to be done to Improve the quality and utility of the data produced. 

To document some of the changes that have occurred* directly and 
indirectly as a result of Title I evaluation activities* there are numerous 
examples of SEAs and LEAs in which TIERS guidelines* often accompanied by 
TAC assistance* have been used to improve evaluation and educational procedures^ 

Typically these examples occur in several areas* each of which has 
already been briefly Introduced! program Improvement evaluation* Improved 
testing procedures* needs assessment* student selection* quality control 
systems* use of new technology* Identifying exemplary projects* summer school 
evaluations and sustained effects. Case studies* which are used here In 
order to develop a national perspective on SEA and LEA activities in 
these areas* follow* 

Program Improvement Evaluation 

Df growing significance are the cases of SEAs and LEAs that are 
utilizing evaluation procedures that go beyond TIERS and beyond only 
collecting and using Impact data. Often* the focus of these actTvfcles 
Is to examine program Implementation. The following brief examples 
represent only a small sample of such activities* and while they may 
often appear to be modest In scope they are significant In that they 
represent an Increasing movement on the part of SEAs and LEAs to use 
evaluation as a management tool to Improve programs. (An objective 
assessment of the utility of TIERS and TACs in helping to improve local 
programs is currently underway. While the Executive Snmmary will be 
appended to this report* more detailed examples may be found in the 
portion of that study dealing with Title I evaluation utilization.) 

0 The New York State Department of Education Is the principal 

architect in the development of a system known as Program Activity 
Monitoring (or PAM). With the help of a 1980 "State Refine- 
ment" contract* this system (which monitors progress of a class 
throughout the year via test results and teacher responses to a 
series of questionnaires) is now being Implemented In intermediate 
service units in New York. The system Includes descriptive 
information about Title I programs In different buildings and 
other data related to program Implementation such as time on 
task. If this information shows that certain factors are not 
occurring as planned* then steps can be taken to correct them. 

- bo 
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The Nebraska State Title I Office Is now in the process of 
completinq field tests on the Nebraska Title I ''Program 
Implementation Scale." The scale enables teachers and admini- 
strators to look at a number of different components related 
to pronran Implementation, Including curriculum and adiiilnlstra- 
tlon. Thert^ seems to be a correlation between positive 
responses on the sca1e» Indicating the presence of certain 
program components, and student achievement* The scale was 
pilot tested last year on 40 Nebraska Title I projects, and 
may be used this year even more widely* 

The States of California and Arizona are emphasizing workshops 
for SEA and LEA staff on evaluating program implementation* 
These TAC workshops were completed in November^ 1981 and the TAC 
is presently contacting participants for a fol1ow-up» to take 
the form of special assistance to Title I sites to help them 
formulate strategies to examine program Implementation* As a 
result of these initial workshops on evaluating program imple- 
mentation* Arizona Is now working with the TAC to create 
more specific materials that will help Title I staff to examine 
related topics* such as measuring time on task in order to 
increase productive Instructional time in the Title I program. 

The Flagstaff* Arizona school district has developed a comprehensive 
Title I data base that Includes TIERS as well as other demographic 
information* This data base allows the district to conduct 
longitudinal studies related to Title I gains and to examine 
what happens to students whose Title I services are discontinued* 

One Virginia county used TIERS data to support their deci- 
sion on how to configure their Title I staffing when faced 
with cutbacks* Some Title I students were being taught 
by resource teachers only* while others were receiving 
instructional services from resource teachers and aides* 
TIERS data* along with other evaluation information* was used 
to show that the use of aides* at least In that county* was 
not cost-effective* 

The Michigan State Department of Education and its TAC are 
developing and Implementing a plan that will be directed 
at improving programs in Title I schools that have high needs 
and limited resources* Currently, the focus of this project 
is to develop specific Intervention strategies for Incorporating 
principles previously identified from the literature Into 
teaching practice* Following these phases, the TAC will assist 
the Michigan SEA and local Title I projects **ith evaluating 
the effectiveness of the Implementation strategies* 

As part of a "State Refinements" contract* two researchers in the 
Indiana SEA Interviewed 10 randomly chosen Title I LEAs to rfeterrnlne 
how they use evaluation Information* The following excerpts are 
from their final report; 
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"Th:r data clearly supports the proposition that LEAs are 
using Title I evaluation information. Only one LEA reported 
that the sole reason they do the evaluation is because 'the 
State requires it.' In four LEAs» TIERS performed a major 
role and provided critical information for major instructional 
program changes. In two of these four LEAs> TIERS supplied 
the objective information which confirmed the decision that 
change was needed. In the other two LEAs» TIERS stimulated 
local decision makers to examine the Title I programs more 
closely and to determine if a need for change existed. 

Teveral other uses of TIERS were evident. Seven of 10 
Title I coordinators viewed TIERS as a measure of overall 
program 'effectiveness' or 'as a global indicator that some- 
thing is right or something is wrong.' Six LEAs communicated 
the results to the parents of Title I students. In four LEAs» 
teachers used TIERS information In instructional planning and 
student evaluation. One LEA included TIERS data as information 
utilized in employee accountability. 

"Nine of 10 Title I LEAs clearly make an effort at least 
yearly to determine the effectiveness* strengths* and weaknesses 
of their Title I programs. All 9 LEAs use multiple sources of 
information to nuke these determinations. TIERS is an important 
source in every situation." 

"Overall, LEAs view TIERS in a favorable Vljht. Their opinions 
range f*^ viewing it as adequate to extremely worthwhile. Only 
one LEA expressed an unfavorable viewpoint towards it." 

0 In New Hampshire* State and TAC staff have worked with small groups 
of local Title I projects using "Strategies*" a series of workshops 
designed to help local projects design and conduct their own 
program implementation evaluation. "Strategies" has four distinct 
steps. The first workshop focuses on how to define the key or 
critical components of their project. This is followed by a session 
where critical components for evaluation are selected and questions 
of interest to the project staff are formulated. As requested. 
State and TAC staff help these Title I projects design their evalua- 
tion and select or create instruments. Once tliis is accomplished, 
each Title I project implements its own evaluation design. They 
then share How the data were analyzed, report conclusions, and 
discuss their recommendations for program changes. 

This technique has been used successfully with fi s Title I 
projects in southern New Hampshire and all five made changes 
in their programs as a result. Among the topics they evaluated 
were: 

— the relationship between achievemen*: gains and parent involvement, 

" the relationship between achievement and teacher or Ti, " I tutor 
communication, 

the types and frequency of communication between classroom teachers 
and Title I teachers. 
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0 In 1979-80, the largest communUy In Maine designed and Inplemented 
<i larqe-scale evaluation of how Its Title I program was belnq 
conducted* Based on a review of Title I Impact Information by the 
Superintendent of Schools* which showed large variations In gains 
among Title I students In some schools, the TAC was asked to assist 
school staff with their program Implementation evaluation. The 
study* Involving more than a year of work, lead to 49 recommendations 
In the area of Program Implementation* 

The following year* an Investigation to see the extent to which 
this program Implementation evaluation was used and whether or 
not the recomr Nations were followed found that of the 49 
recommendations contained In the report* Z6 (53%) had been Imple- 
mented district*w1de and others were Implemented In different 
schools* These recommendations were not trivial* ranging from 
revised Title I student selection criteria to Instituting regular 
planning and in-service programs for Title I teachers* 



Improved Testing Procedures 

Improved testing procedures can be seen in the better selection, aciminl 
stration and use of test results as well as in efforts to reduce testing 
burden* Changes In how tests are selected and used are obvious in 
several areas* Generally speaking* there has been an Increased sophisti- 
cation on the part of SLAs and LEAs In test selection and use* 
Improvement in test selection has In turn brought about more cost-effectiv:i 
use of tests* since the selected tests are used to meet a wider array 
of needs and have increasingly heen used for Instructional purposes 
as well as to evaluate pupil progress and program effects* 

Test selection * By and large* there has been an increased aware- 
ness on the part of SEAs and LEAs of the benefits of selecting tests 
with items that match the Instructional objectives of Title I projects* 
There is more aw;»reness of applying appropriate criteria for evaluating 
tests {e*g** content validity* reliability* administration procedures, 
scoring options* and costs)* This enhanced knowledge has often resulted 
in SEAs and LEAs selecting new or different tests for Title T projects. 
Where in the past a single test was used statewide, as In the case of 
Rhode Island and Hawaii* Individual LEAs now select tests which 
better reflect the instructional emphases of their Title I projects* 

Often, an SEA/LEA test review committee was established to examine 
test materials and to recommend or select suitable tests* This was 
done, for example* 1n Bay City* Texas* Breaux Sridge* Louslana, 
f^hode Island* Connecticut, and Hawaii* In other instances* participants 
in a test selection workshop either selected new tests themselves or 
recommended their choices to the SEA or LEA Title I adm1f>^'strators* 
This was done in LEAs in Arizona and In Maryland* among other places* 
The participatory test selection Process has generally resulted in <* 
strong commitment on the part of local Title I staff to subsequently 
using test results for evaluation and Instruction* 
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Test selection based on appropriate criteria coupled with strong 
staff commitment to test use has contributed to clarification of curri- 
cular objectives, better test administration, and more effective test 
use. for somo LEAs, the selection of a new test has meant the restruc- 
turing of the testinq program to avoid duplication and to reduce test 
Uiirden* Such was the caso In Billinqs, Montana and Salt Lake City, 
Utah, In otner SEAs and LEAs, test information can be linked to 
national and local results through test equating (Stamford, Connecticut; 
Illinois; New Jersey) or by creating State norms (New York and New Jersey)* 

In Maryland, the Title I State Department of Education has implemented 
an effort aimed at reducing the burden of Title I evaluation through 
a series of test selection workshops, accompanied by presentations 
from test publisher representatives and TAC staff. These workshops 
were aimed particularly at exploring tests that could be used to provide 
diagnostic as weil as evaluative Information to project directors 
and Title I classroom teachers. Based on these workshops, several 
counties have changed their testing programs entirely so that a diag- 
nostic, norm-referenced test can now be given In the fall to serve as 
both the Title I pretest and as a source of diagnostic information, 
replacing a number of other diagnostic tests that had previously been 
gi ven* 

Test use . A significant departure from past practice is the SEA 
mandate on test use. In Maryland^ for instance, using test data for 
decision making has become a required element of project applications. 
Site visit reports prepared by SEA personnel include mention of the 
extent to which test results were used in the various counties, in 
States such as Nebraska and Kansas, Title I data are used by the SEA as 
a criterion for identifying exemplary projects. 

Title I test results are Increasingly being used for instructional 
purposes. Examples of such use can be found In Salt Lake City, Utah; 
Stamford, Connecticut; Maryland; and Hawaii. Test data are used for ne3ds 
assessment, diagnosis and the preparation of individualized educational 
plans (lEP's) as well as for summatlve evaluation. In Salt Lake City, 
for Instance, Title I pretest data v;ere used to identify weaknesses in 
the instructional process. Title I staff then attempted to remedy the 
weak areas during the project year. 

Another significant use of test results consists of secondary analysis 
of test data gathered during past project years. In Hawaii, for instance, 
data ^ire heing analyzed on a longitudinal basis for three project years to 
Address SEA level questions concerning effects of project settings. Instruc- 
tional strategies and materials. The district has !>een implementing an 
instructional strategies profile which looks at the Title I program In a 
total school context and includes TIERS as well as program implementation 
(lata. This allows the district to use the data to see which instructional 
strategies are being used with Title I students, and which are having an 
impact and which are not. 
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Test use Is facilitated by means of creative cotiununlcatlons media. 
Through graphic displays of test data* teacher groups In Hawaii have been 
c ; to share test Information with parent groups In ways readily compre- 
henslble to the latter. Brief and concise reporting formats have been 
used to enhance the readability and usefulness of reports. In West 
Chester County. New York, for Instance* concise one-page reports were 
prepared for school boards. In Yakima* Washington* the use of a video-tape 
to present Title I data was well received by school board members. 

Reducing test burden . In order to evaluate the educational Impact 
of a Title I project and In order to monitor student progress* a variety of 
information has to be obtained during the course of a Title I evaluation. 
A "selection test" Is often used In order to collect the information by 
which students are selected for participation In the Title I project. 
A "pretest" Is used to collect Information regarding students* achievement 
prior to participation In t^e project* and a "posttest" Is used to 
collect similar Information after participation In the project. 

Administration of these tests* especially when coirbined with those 
of testing programs unrelated to Title I* sometimes creates a considerable 
burden on the local school systems* a burden which could be manifested In a 
nun^er of ways. It may be financial* in that testing costs money. It 
may also be seen In decreased hours available for Instruction* disrupted 
classroom routine* Increased staff responsibility* or any of a variety 
of other "costs" of testing. Test burden proved to be a serious problem* 
but Title I funds were attractive enough to local school systems that 
the burden was borne. 

One of the more common problems that the TACs have encountered while 
working with local systems is that of reducing this test burden while 
maintaining a high level of technical quality of Title I project 
evaluations* ensuring that needed educational information for a variety 
of needs and audiences Is produced* and simultaneously assisting SEAs 
and LEAs In complying with their evaluation requirements. A nuniber of 
partial solutions to this general problem have proven useful. 

One solution Is to use some sort of pre-selectlon information to 
reduce the number of students who are administered the «^9lect1on tesc. 
For example* teachers' ratings may be used to identify those students 
who are unlikely to qualify for a Title I program. Th?se students would 
then not be administered the selection test* thereby rcKlucIng the number 
of direct and Indirect financial costs as well as the number of "student- 
hours" required by the system for testing. Scores obtained through 
programs unrelated to Title I evaluation* such as those obtained through 
district or State testing programs may be used in the 5ame way. If this 
pre-selectlon measure Is of a high quality* a separate Title I selection 
test may not have to be given to even a small nunber of students. 

Albuquerque* New Mexico* for example* selects students for Title I 
progmtns on the basis of a student rating scale completed for each student 
by their teacher. With TAC assistance* Manatee County* Florida* tias 
developed a novel approach to the selection process. Students work their 
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way through a series of books of graduated difficulty at their own pace» 
with the student's progress through the series recorded every few weeks 
by their teacher. This Information Is then used to select students 
for Title I programs. 

An additional way to use data already collected Involves using testing 
program Information for Title I pretest and/or posttest data. Ir< some 
cases, norms had to be developed by a State to provide the Information 
required for Title I evaluation. In New Yoric» for example, a criterion- 
referenced test Is administered as a component of a statewide basic skills 
assessment program. Estimated national norms for this test are being 
developed and will allow local school systems to obtain the scores they 
neec* for Title I eve*uat1on without the administration of a separate test. 

Similar activities involve the equating of tests which meet Title I 
evaluation requirements to tests already In use. South Carolina provides 
a good example of just such an activity. Since the mid-1970s. South Carolina 
has sponsored census administration of a norm- referenced test as part of Its 
statewide testing program. This test was administered to thtrd, sixth, 
and eleventh grade students In the spring of each year, and In a number 
of districts, census testing was also performed In grades other than those 
required by the State. This test provides data appropriate for use In Title I 
evaluation. Beginning In 1981, however, the State Implemented its own 
criterion- referenced test In grades 1, Z, 3, 6, and 8 and the norm* referenced 
testing was changed to grades 4, 7, and 10. At the request of South Carolina, 
their TAC began a technical Investigation of the feasibility of equating 
the new criterion-referenced test to the norm- referenced test In order to 
estimate national norms. Otherwise, each Title I project wanting to use 
the criterion-referenced test for evaluation would also have to administer 
a norm- referenced test and conduct Its own equating. For similar reasons, 
TAC has assisted in equating a series of locally developed criterion-referenced 
tests to a norm- referenced standardized test for the Stamford Public School 
system In Connecticut. A similar project Is also underway In New Jersey 
In which the State-mandated Minimum Basic Skills Test Is being equated to 
a norm-referenced test. 

A different approach to reducing test burden Involves generating both 
a pretest score and a posttest score from the results of a single, annual 
test administration. Each test administration provides posttest scores 
for the evaluation of the previous year's Title I program along with pretest 
scores for the evaluation of the following year's urogram. It Is also 
possible. In certain situations, to use this annual test for selection 
purposes as well. A program In Rochester, New york, is typical of mar^y 
districts using this approach. 

These and other approaches to reduction of test burden are examples of 
Joint efforts made by local and State school systems, often with help from their 
TACs. These efforts have resulted In project evaluations which are both as 
economical as possible while still maintaining a high technical quality. 
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Title I Needs Assessment 

Section 124(b) of Public Law 95-561 spells out a five step needs ass-jss- 
ment process for Title I, The steps call for each district to: 

0 identify educationally deprived children in eligible attendance areas» 

0 identify the general Instructional areas of focus» 

0 select Title I students » 

0 diagnose Title I students' educational needs» and 

n write objectives and plan instruction based on Identified needs* 

Objective data are to be used in completing steps two and three* 
Both States and individual districts have made efforts over the past 
five years to improve needs assessment by using objective data in completing 
the planning sequence outlined above* Specific activities relevant to 
student selection are discussed in other sections of this report* The 
following sections of this chapter will document State and local efforts in 
improving their needs assessment processes* 

State efforts * States have often voiced dissatisfaction with 
district-level planning efforts because the Title I plans presented 
were not based on information that documented local needs* Over the 
past five years» some SEAs have taken several approaches to improving the 
quality of their districts' needs assesments* These approaches have 
Included sponsorship of regional workshops focused on needs assessment* 
restructuring of applications to require specific needs assessment infor- 
mation and development of handbooks or guidelines on needs assessment* 
TAC involvement in these efforts has included consultation* instrument 
review and development* co-development of handbooks* and development 
and presentation of workshops* At the request of EO* the TACs have 
developed four standard workshops which cover the needs assessment steps* 

Massachusetts was early to sponsor needs assessment workshops* 
These workshnps* offered regionally* allowed a number of districts to 
attend the same presentation* At the State's request the Region I TAC 
developed a workshop covering use of test scores* survey dnd questionnaire 
design and use of other information available In school records* Worksheets 
and instruments for collecting teacher ratings were widely disseminated 
and used by many districts* Similar regional needs assessment workshops 
have been sponsored by the States of Hawaii* Idaho (which focused on the 
diagnosis and planninq steps)* and Maine* 

Oregon chose a different approach for enhancing needs assessments 
by developing a manual on the topic* The manual* called Program 
Management and Planning: Weeds Assessment and Project Development for 
Oregon Title I* ESEA Projects took several years of work* Initial State 
activities included Increased attention to the needs assessment durinq 
monitoring* State monitors encouraged PAC assumption of responsibility 
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for the needs assessment* At the same t1me« monitors beqan to encouracje 
the use of test results for needs assessment and student selection* As 
districts began to use tests more widely* forms for gathering staff 
and parent opinions were circulated along with worksheets for confining 
needs assessment results* A needs assessment model was developed to 
include the five required steps* In 1980 and 1981 these activities 
culminated in a manual which describes the model* discusses types of 
data to collect and includes surveys and summary worksheets which have 
been successfully used in Oregon* During this process* the Region 10 
TAC assisted in finding o: developing instruments and also reviewed 
the manual* 

New Hampshire followed a similar path* eventually producing* with 
TAC assistance* Suggested Procedures for Long Range Planning and Annual 
Needs Assessment^ This manual is usually used in conjunction with State- 
sponsored workshops* The manual contains sections which describe each 
step of a long-range planning process and appendices which provide 
additional guidance and detail* New Hampshire's lonq-range planning 
process follows a three-year cycle* The first year ^s a comprehensive 
assessment for long-range planning* In subsequent years the assessment 
serves as an update* checking how well needs are met* problems in meeting 
needs and satisfaction with the program* 

Montana's Office of Public Instruction Title I consultants developed 
their own needs assessment workshop using TAC developed materials in 
conjunction with locally designed handouts* The State monitoring form 
was also revised to place more emphasis on the various needs assessment 
steps* 

Puerto Rico developed a teacher ratinq scale used throughout the 
Territory* This rating scale is used to rank all students and identify 
those who are disadvantaged* The needs assessment steps for idenclfying 
eligible students* identifying instructional areas* and se1ect1n<; 
students are now standardized throughout the Territory* 

District efforts * School districts have also been active in 
improving the needs assessment process* Their efforts sometimes preceded 
State activities* but more often evolved from them* District interest 
in needs assessment is reflected in several ways -- by attendance at 
State-sponsored workshops* by requests for consultation on their needs 
assessments* by use of disseminated needs assessment forms and procedures* 
and by internal studies of their needs assessment process* 

Many needs assessment workshops have been sponsored by State Depart* 
ments of Education and have used TAC staff and materials* In general* 
districts* attendance at these workshops is optional* Needs assessment 
topics are popular* however* and workshops offered across the country in 
1980-81 attracted numerous participants* 
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A number of districts havd sought TAC assistance In revising their 
needs assessment procedures* Consultations have been as simple as 
supplying sample Instruments and forms or as cofnplex as analyz'fng 
existing needs assessment procedures* reconnendlng alternative prac« 
tices and training staff in Irnplementing new procedures* 

While major changes may take considerable t1me» more modest changes 
can occur rather quickly* Inspection of fall pretest data at the primary 
level In Salt Lake City suggested the need for more emphasis on word 
analysis skills* Title I staff in each building were apprised of the 
finding and by the end of the school year children's skills in this area 
were comparable to their skill levels in other aspects of reading* In 
this case» the Inspection of data patterns resulted In a need being 
identified and a plan for meeting It being developed* 

As concern about budget cuts has Increased during the past year» 
districts showed great Interest In etTq)loying needs assessments for planning 
where their Title I programs could be scaled back If necessary* Questions 
were raised on how to use needs assessments to decide whether to reduce 
program areas » grade levels served* type of staff or total number of 
students served* 

At least one district has commissioned a stu^y to examine their 
needs assessment process* The Honolulu school system has recently 
written an RFP for an outside contractor to look at whether their Title I 
program meets the needs of Title I schools* Results of this stu^y should 
be usefuU particularly In revising the diagnosis and instructional 
planning steps* 

Student Selection 

ESEA Title I provides services designed to improve the achievement 
of the most educationally disadvantaged students* A method for selecting 
participants* In addition to needs assessment procedures* Is necessary 
because schools cannot serve all those who are identified In the needs 
assessment* Schools have to select students for the program from a 
local pool of educationally disadvantaged children* 

School districts and States have evolved ways of Implementing this 
selection process and they have developed ways to help schools better 
decide just who their most nee^y students are* 

As discussed earlier* Title I is designed to help educationally 
disadvantaged students from economically deprived areas* It is not 
aid to only those who are educationally disadvantaged* nor is It aid 
to only those who live In economically deprived areas* Although there 
is a substantial correlation between being educationally disadvantaged 
and living in an economically deprived area* that correlation is not 
perfect* Educationally disadvantaged students live In non-economically 
deprived areas* and not all students living in economically deprived 
areas are educationally disadvantaged* When combined with measurement 
instruments that are leos than perfect (as are all tests or other forms 
of objective measurement* e*g* teacher judgment of student need)* the 
net result Is that children are selected to receive services who In many 
cases are not poor* and In some cases may not be very disadvantaged 
odiKationally* 
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It is often difficult to define "educational disadvantagement." 
Some people base disadvantagement on standardized test scores because 
they are objective* reasonably valid and reliable* and outside the usual 
classroom experience. Many States and ntost school districts (e.g.. Hew 
York» Ohio* Baltimore, Chicago* and Dallas) now define educational dis- 
advantagement In terms of performance on either a locall> developed. 
State developed, or commercial standardized test. 

Critics of standardized tests often contend that standardized 
test results give only a snapshot of achievement. They suggest that 
measures of true educational need best come from what teachers say 
about their students, since they work with students for an extended 
period of time, and on many educational tasks. Critics of such an 
approach point to the problems Inherent in any scch subjective process. 

The result is that although test scores «ind teacher judgments of 
educational need agree for many students, there Is disagreement for 
many other students, especially those who are on the borderline of being 
in the program. Unless uniform and consistent procedures are used, a 
strong case can be made based on one of the two above criteria that the 
most needy were in fact not being served. Some students who score rela- 
tively well on tests will be Judged in need of special help by the teacher. 
Other students who do relatively well in classwork will do poorly on 
tests. 

Examples of difficulty in selecting students abound. At the Federal 
level, the Decima substudy of the sustaining effects study suggested that 
many of those who were needy were not oeing served at the same time that 
many who could be considered not needy were being served. The 1977 NIE 
survey of compensatory education corroborated this conclusion* Federal 
Title I program review teams also Indicated that student selection was 
one of their most frequently observed problem areas. 

At the state level. Internal program monitoring has uncovered similar 
problems. Strong cases could be made where schools were not selecting 
students in ways that were either consistently or uniformly applied. 
Procedures for selecting students were sometimes arbitrary, un.-^lated to 
educational need, or deficient In Identifying those most In need. 

.ince no one at either the local. State, or Federal level was in 
favor of selecting students who \iere othe/* than the most needy, response 
to the selection problem was Imnediate. At the Federal level, a five 
step needs assessment process, with student selection as one of the 
steps, appeared In the ig/g Title I regulations. Local schools were 
required to explain their selection procedures to the State when they 
applied for their money. At the State level, standards for educational 
disadvantagement were being defined (e.g., performance below a certain 
level on some standardized test) and guidelines for selecting students 
were developed. Local school personnel began searching for more objective 
processes with which to assess and define student need, whether by test 
score or teacher judgment, and they often asked TAC staff for Ideas on 
how best to develop and apply the school's criteria In selecting 
students. Procedures being used were shared among and between the States 
and schools, with staff adopting and adapting procedures they found 
useful. 
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What has been gained thus far from this concern about how students 
are selected? F1rst» schools have become more systematic In their use 
of selection devices* For exanip1e» Staunton* Virginia substantially 
reduced the number and types of tests and ratings i^^ed by their schools 
to select students* Redundant assessflient and Its accompanying paperwork 
were eliminated* Uniform and consistent procedures were Introduced* 
In Puerto Rico» for the first t1me» uniform criteria a^e being applied 
to select their program students for the school year beginning in 1982* 
There too» paperwork has been streamlined and selection has become more 
efficient and effective* 

Second* States have been either suggesting or requiring that schools 
use multiple indicators to select those students who are most in need; 
for exaifip1e» New Jersey and Hassachusetts* Using multiple indicators is 
more valid than using oniy one indicator^ where poor performance on one 
indicator can never be compensated for by good perforndnce on some other 
equally valid indicator* At the local level » more schools are using 
both teacher ratings and test scores to select their Title I students* 
Att1eboro» Massachusetts » B1111ngs» Montana* and Meridian* Idaho are 
exan^Jles of schools that have used composites of both test scores and 
teacher judgments to select students* 

Third* some States have coordinated policies on remedial education 
with Title I selection criteria* for example* both New York and New 
Jersey have adopted selection criteria based on performance on their 
State mandated tests* In both States* students who fail the tests 
are to be placed in some related remedial program* These State mandates 
have been incorporated In Title I selection policy where applicable* 

Fourth* and most importantly* local schools have adopted more ob- 
jective* valid* and reliable means of assessing teacher judgment of 
need for Title I* Schools often experienced difficulty when trying to 
apply teacher judgment to the selection process* Often students who 
scored above the 50th percentile on a nationally normed test were beinq 
selected for the program* Sometimes the judgments were arbitrary and 
unstructured* Title I teachers sometimes found students sent to them 
were not really the neediest* Often* one would not know a student's 
specific weakness when teachers used unstructured judgment to select 
program students* 

Now* schools are more often assessing teacher judgments of student 
noed tlirough a structured* formal rating system* Such systems have been 
found to be more valid and reliable than previously used systems* Albuquerque* 
New Mexico* Granite* Utah* Jersey City* New Jersey* and Lexington* Virginia 
^re examples of local schools that have Invested heavily in developing systems 
for assessing teacher judgment* The Albuquerque method has been widely 
dtsseminated and currently is being recommended In other States* such as Arkansas* 

Fifth* selection rules that are uniform and consistent are more often 
used now by schools throughout the nation* Uniform and consistent selection 
rules are objective* They let parents* teachers* and administrators know 
exactly what student behaviors Indicate a need for Title I* 
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An tm5ptic1.)atftc hy-product of the Title I Evaluation and Reportinq 
SysterTi (TIEkS) ras beer, tne focus of attention on quality control of 
data re^)orU(i by LEAs to the SEA Title I unit and subsequently to ED. 
Durinq the past five years almost every State In the United States has 
sriov/n so;ne concern about the accuracy of the data reported and has made 
some attempt to determine how well TIERS implementation rules have been 
fol towed. 

Oocumeiited reports on quality of data exist for at least seven States^ 
and while dUferent types of analyses have been done from State to 
State over different periods of time^ they all add up to one thing 
data submitted by an LEA should be viewed as tentative until verified 
as accurate. While one can conjecture that tests that are hand-scored 
at the school level are more susceptible to error than those reported 
by a reputable scoring ?ervice» errors have been detected in computerized 
class lists that have been prepared by reoutable companies. A wrong 
tape can be mounted^ out-of-grade-level conversions can be improperly 
done, or computer norms tapes may be faulty. 

The types of errors discovered with hand-scoring have included reading 
the wrong table, reading the wrong numbers from the right table» errors 
in arithmetic* transposition of diqits, and the like. In one carefully 
done study (Pennsylvania^ 1979)^ more than 13% of the individual scores 
were in error* involving 39% of the LEAs. In another study* Crane (1980) 
found 32% (1978) ;*nd 26% (1979) of the projects examined used incorrect 
tables In their conversion of standard scores to percentiles. Other 
studies have found up to 67% of individual student scores in error 
(Elman^ 1981) due simply to coding errors that incorrectly identified 
characteristics of the test used. Mhile it is difficult to generalize 
from these findinqs^ it is safe to say that without close attention 
to data quality, a substantial proportion of evaluation data can be 
expected to be in error. 

From these discoveries have come an increased sensitivity to the 
fanibility of data and the necessity of building in safeguards that 
will prevent or cor/ect the errors that have occurred in the past. 

SEAs have generally taken one of two basic approaches: (1) a heavy 
reliance on in-service training of LEA staff in the preparation of 
reporting forms^ or (2) shifting the burden of score conversions to the 
SEA» thus reducinq the chances of error at the LEA level. 

LEA Activiti es. Maine* Rhode Island^ Arkansas* and a number 
of States in thf northwest regions of the country* especially Oregon* 
have all taken the first approach and have designed training programs 
aimed at imProv^g the accuracy of the reports that LEAs prepare for the 
SEA. In 1976^ a q^'^lity assurance project called the Maine Verification 
Program (MVP) was instituted by the Title I Office in Maine. The purpose 
of the MVP has been to help selected communities conduct a rigorous 
implementation of TIERS. The Region I TAC provided participating commun- 
ities with intensive training on TIERS accompained by verification or 
auditinq oY the data prepared by LEA personnel and follow*up until the 
LEA coulci conduct an error*free evaluation on its own (Herr* 1981). 
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During the first year» 25 Title I programs were selected to participate 
in the system. The Maine SEA nominated LEAs because: (1) an LEA had 
reported unusually high NCE gains* (2) the community had voiced a concern* 
or (3) the LEA fell in the category of special SEA concerns {i.e.. an 
exemplary or questionable program). 

As of fiscal year 1980-81, five cycles of the Maine Verification 
Program have taken place involving a total of 58 programs. Forty-one of 
these* or 71t» provided overall usable data. Of the original 
25 in the program in 1977» 23 were still in the program and 19 of them 
(83%) provided overall usable Jata. These data indicate both that the 
longer an lEA remains in the system the higher the probability that 
the quality of its data will improve and that it usually takes longer 
than one year to register a marked improvoRcnt. 

In Rhode Island* under a State Refinements contract and with TAC 
assistance* a formal analysis was made of data submitted during fiscal 
year 1977-78 to determine: (1) the amount of data error in reported 
scores* and (2) the common errors made across the State. Based upw) 
these findings* Rhode Island developed procedures* materials* and 
training packages designed to minimize data error. These included a 
slide-tape presentation that explains how to administer a standardized 
test* a template for administrators* manuals designed to prevent errors 
in reading tables* and a newsletter to address those questions commonly 
asked by Title I directors and teachers. 

Arkansas developed an Evaluation Hanual that fcrms the backbone of 
that State's effort to minimize errors. The SEA also developed a 
19-item checklist that provides feedback to LEAs and suggestions for 
correcting errors in the future. In addition* the SEA has also stepped 
up the checking of all^ data sent in by LEAs. This Is done for the entire 
State and represents an improvement over the previous practice of spot 
checking by different persons who have other monitoring functions In the 
field. 

In Oregon* and some other States in the northwest* intensive 
group consultations on how to complete forms have been used 
to Improve the quality of the data. The distinctive feature of this 
approach has been "hands-on" training sessions held twice a year. 
Participants arrive at joint SEA-TAC fall meetings with their data 
sheets and record all of the necessary pretest Information. Ihey 
review what subsequent information will be needed to complete their 
evaluations and then return in the spring to add the posttest data 
and complete their analysis. 

The above examples are meant to be illustrative* not exhaustive* of 
the types of activities in which States are currently engaged. Around 
the country* many SEAs are engaging in similar activities with their LEAs 
that are undocumented in this report. 

Activities at the SEA level . An SEA that took an early interest In 
implementing the second approach toward quality control " shifting the 
burden of score conversion to the SEA and away from the LEA — is the 
State of Iowa. In a 1977 study* the typical kinds of errors described 
earlier were found; in fact* about 95t of the LEAs that provided hand- 
(d <icored information had made errors in their evaluations. The SEA decided 
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to have LEAs report individual pupil raw scores and make all score con- 
versions and perform all calculations at the SEA leveK Assisted by 
the TAC» Iowa has worked to develop and perfect this system over the 
past three years* In order to implement the system^ U was necessary to 
use the proprietary materials of test publishers* so special agrements 
were made with th&n In order to avoid any Infringement of copyright 
laws# 

The enormity of this system* which was built to accommodate 12 
commonly used standardized achievement tests (any form* level* edition* 
and subtest)* can best be Illustrated by the fact that approximately 
15*000 different norms tables currently are required* Part of the 
programming effort has included checking to see if criteria for proper 
implementation of the TIERS evaluation models have been met* Progressive 
Increases in the percent of valid data have occurred during the last 
three years* In 1978* 83% of the reading data were usable and met the 
criteria for inclusion; In 1979* the percent rose to 92%; and in 1980* 
to 96%* For mathematics* the results were similar* going from 74% In 
1978* to 92% In 1979* and to 95% in 1980* 

Both Pennsylvania and Illinois have selected this method of 
(uther States* like New York* already had similar systems in place) 
collecting individual pupil raw scores as a way to Improve quality 
and reduce the reporting burden on the LEA* and have benefitted greatly 
from the work previously done in Iowa* 

The development of the lowa system of quality control has also lead 
to the development of feedback reports from SEAs to their LEAs that: 
(I) summarize school and district results* and (2) give diagnostic 
Information regarding the proper implementation of the evaluation models* 
In addition to Iowa* both Missouri and Nebraska have Incorporated this 
LEA feedback feature In their reporting system* The Missouri SEA 
plans to continue with TIERS and to use the current feedback form next 
year* even though this Is no longer required under ECIA* Other SEAs will 
undoubtedly also choose to maintain their current evaluation systems* 

Use of New Technology In Title ! Evaluation and Program Management 

During the six years that the Title I evaluation Technical 
Assistance Centers have been in existence* they have tried to keep 
abreast* and make their clients aware* of new technological innovations 
that can make the tasks and the products of evaluation easier to handle> 
mo^e accurate* and easier to communicate* Advances In computer technology 
have reduced the burden of hand recordkeeping and data analysis while 
Increasing precision* At the same t1me> advances in the areas of 
educational television and teleconferencing have Increased our capacity 
to communicate complicated material In a timely and efficient manner* 

Advances In microcomputer technology have resulted In more efficient 
ways to enter and store data* to analyze data and to generate reports* 
For example* a district In south Louisiana had developed their own 
criterion-referenced test* They were scoring this test by hand and 
using the results to select students for their Title I program* The 
test required several weeks to score* the scoring procedure was prone 
to error* and the slow turn-around failed to provide the classroom 
teachers with timely diagnostic Information* 
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The district purchased a microcomputer and an Inexpensive mark- 
sense reader* Using a program developed by the TACs, the district was 
able to read the answer sheets for a11 students and to store their 
test responses on ^ magnetic diskette* The teachers received a complete 
printout of their students* test performance, Including the Itoms missed 
and the domains passed and failed* They received these data two days 
after the test was administered. 

Non-standardized achievement test data are also being stored on 
this microcomputer, and the data analyses required for Title I reporting 
are performed by another TAC-developed program* This means that errors 
in converting percentiles to NCEs as well as other computatonal errors 
have been significantly reduced* 

SEAs have also found that microcomputers can be of significant help 
in reducing their burden of hand-checking LEA reports* Vermont decided 
to use a microcomputer to perform the Title I analysis for all districts 
in the State* Working with the TAC, they were able to have the LEAs 
simply submit basic unanalyzed data, perform the analysis In-house, 
and return Individual school results to each district as well as to 
summarize those re!>ults for their report to ED* 

Another State, Rhode Island, was Interested using the mlcro^ 
computer as a means of quality control* One of the most common errors 
in reporting Title I data to States Is In converting test scores to 
NCEs* The SEA asked the TAC to develop a program that could estimate 
NCEs directly from standard scores* This then enabled the SEA to 
detect those LEA-reported NCE scores that were obviously in error* 

On a larger scale» the State of Alaska, through a State Refinements 
contract and with some TAC assistance, has been developing software 
for all of their schools* Data can be entered and stored at a local 
level and then transmitted via satellite to Juneau, where the SEA*s 
large computer then Is used to generate the State report on Title I 
as well as to provide local districts with feedback concerning t^e 
success of their program* This link also provides for Immediate 
communication of data on students throughout the State, and allows 
for the transmittal of "electronic mall" to remote districts* 
The system provides a means for increasing quality control as well 
as decreasing the time required for data entry and analysis* 

Workshops are a primary mode of Information presentation through- 
out the TAC system, and technologies such as teleconferencing, public 
broadcasting and videotaping have been utilized by TACs to deliver 
information In a workshop setting* For Instance, Colorado* a large 
State that is sparsely populated, has a problem In conducting workshops 
In remote areas* A teleconference workshop method has been successfully 
implemented, with the assistance of the TACs* 

The ii»ethod combines normal phone lines with special teleconference 
machines that a^^ow for the use of microphones and speakers for large 
audiences* A three-^way network was established between the TAC In 
Portland, the State Education Department in Denver, and Regional 
Q Service? Centers throughout the State* The basic workshop format 
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consisted of a topic presentation by the TAC followed by a discussion 
Involving all three agencies* Audio 1nfor^at1on was exchanged through 
an open channel, allowinq spontaneous Interaction* To date, 22 work- 
shops have heen conducted since the fall of 198D, with audiences 
ranging from eight to 35 per workshop* 

Vl^ic^o technology has been used in Georgia and Texas to distribute 
workshop presentations* The Educational Television System in Georgia 
used its network to broadcast a live workshop in 1981 that reached 
139 school districts across the State. A panel of TAC and State 
Education Oepartnent personnel first demonstrated how to fill out 
the evaluation r^iport and then answered specific questions on the 
air via a toll-free telephone* This broadcast precluded the need 
for a series of onslte workshops by effectively delivering the Infor- 
mation in a single session. 

Video Is used In Texas as a major component in workshop packages 
designed to **stand alone* " The packages contain a presenters* guide, 
handouts, and simultion exercises in addition to the videotaped 
presentation* Jh^ are available to LEA staff through the Regional 
Service Centers* Topis of these workshops are usually at a "general 
awareness level," requiring little or no audience interaction* The 
purpose of this mode of presentation is to address a general, recurring 
need without spending excessive resources in staff time and travel. 

Identifying Exemplary Projects 

Title I funds have supported the development and implementation of 
exemplary basic skills programs in all areas of the country. Overall, 
52 Title I programs have been approved for exemplary status by the 
Joint Dissemination Review Panel (JDRP), a panel composed of 22 members 
of the Department of Education (ED) which reviews evidence of effective- 
ness for educational programs and is empowered to designate such programs 
as "exemplary." 

Over the years, ihe proportion of applicant Title I projects which 
have been approved for exemplary status ha^ steadily increased* This 
growing success rate can, to some extent, be attributed to the increased 
coordination of support mechanisms available to Title I programs seeking 
JDRP approval* At this time, most local projects which desire to apply 
fo** exemplary status receive assistance from their State Title I 
office, from ED*s Title I program office, and from a variety of printed 
support materials, including the JDRP Resource Guide for ESEA Title I 
Programs in Basic Skills , JDRP Idea b oolc , Helpful Hints for Preparing 
and Submitting ESEA Title T Regular and Higrant Education Projects to 
the Joint Dissemination Review Panel , and educational Programs That 
Woric^ ' 

Nebraska Is developing a strategy for Title I program improvement 
with special emphasis on instruction.. They will use a modified version 
of the old ESEA Title III-IVD (Implementation, Validation, Dissemination) 
process* Title I projects interested in being reviewed and considered 
for exemplary project status can request an on-site visit by three 
Independent evaluators, each locking at a different aspect of the 
proaram^ e*g*, administration, curriculum, or evaluation evidence. 
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Once a project has exemplary states, other Title I projects wishing to 
Improve their programs can be referred to them for assistance* 

In many States^ a concerted effort has been undertaken to assist 
Title I projects In their JORP application* In Iowa» for example* the 
State Title I office and their TAC have established a set of procedures 
which Integrate State and TAC services for the Identification of 
exemplary local program s1tes» the organization of the sites' Impact 
evaluation data, and the compilation and review of the 10-page program 
descriptions for JDRP submlsslm* Other SEAs have worked with the 
TACs to establish State procedures » modeled after the national JDRP 
process* for validating exemplary Title I programs* South Carolina* 
Nebraski* and Massachusetts* In particular* have developed noteworthy 
State validation systems with the assistance of their respective TAC* 
Projects identified as exemplary through these State systems have general* 
ly been found to be likely candidates for national JDRP validation* 

The dissemination of Title I programs Identified as exemplary has 
been widespread* Typical of JDRP-approved Title I programs which 
have received funding from the National Diffusion Network (NON) as 
Developer/Demonstrator projects Is the Buckingham County* Virginia* 
Computer Assisted Diagnostic Prescriptive Program In Reading and Mathe- 
matics* This program has been adopted (or adapted) in 214 classrooms In 
69 schools across the country since Its validation in 1979* The program 
developer conducted 23 awareness workshops In 14 States and mailed out 
ever 400 information packages about Buckingham County's exemplary 
program In the 1980-81 school year alone* 

In all* 26 Title I programs have received NDN funds to support 
dissemination* These programs range in scope from early childhood 
{e*g« * the Preschool Improvement of Reading PRIOR In Fort 
Collins* Colorar^o) to secondary school programs (e*g** Project CATCHUP 
In Newport 8euCh* California)* The dissemlotion of these exemplary 
Title I programs to numerous project sites across the country has made 
an important contribution to Improving the quality and effectiveness 
of Title I instruction* 

Title 1 Surmier School Evaluations 

The evidence on whether there is a drop^off In student achievement 
over the summer months* when schools are not In session* is inconclusive* 
There was enough concern about sprlng-^to-fall achievement test score 
declines* however* for the Congress to encourage* in the Education 
Amendments of 1978* giving "due consideration to the Inclusion of compo* 
nents designed to sustain the achievement of children b^ond the school 
year in which the program Is conducted* through such means as summer 
programs'* (Section 124(k))* The Amendments added that the evaluations 
of Title I proorams will Include ''objective measurements of educational 
achievement In basic skills over at least a twelve-month period In 
order to determine whether regular school year programs have sustained 
effects over the summer* (Section 12* (g)(2))* Many LEAs responded 
to their own concerns and those of the Congress by offering Title I 
summer programs* and they turned to the SEAs and the TACs to help them 
evaluate the Impact of those programs* 
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The short-term nature and limited focus of summer programs creates 
special prob1«ns for the evaluator^ especially In measuring changes In 
basic skills* Evaluation designs developed for use with regular term 
Title I programs may be inappropriate for use with summer programs^ or 
they may be usable only after considerable adaptation* Summer programs 
may have limited time d'^voted to Instruction^ ma^y be highly Indlvldual- 
ized« may stress nonaca::.m1c objectives^ may use Informal student 
selection procedures^ and may Include non-Title I coursework* These 
characteristics pose evaluation problems that have led the TACs to 
recommend that three evaluation designs be considered: a norm-referenced 
design^ a criterion -referenced design^ and a comparison group design* 
The TACs have workeo with LEAs to select the best design for the local 
situation* 

An Intensive study of the Title I summer school program In the 
Columbia^ Missouri^ Public Schools showed that participation Involving 
two hours per day of classroom activities during a 34-day session had 
an Impact on reading achievement levels^ as measured three months later* 
The evaluation design utilized a comparison of summer school participant 
test scores with national norms and with scores of regular term Title I 
students who did not participate during the summer* Title I summer 
school participants showed no gain In reading achievement over the 
sufmner^ but Title I students not participating showed an appreciable 
loss* It appeared that summer school permitted the previous year's 
Title I gains to be sustained over the summer* 

The St* Louis, Missouri, Public Schools offered a six-week Title I 
program In 48 schools* Each site was well staffed and class size was 
limited to 10 pupils, with 1\^truct1on provided four hours per day, 
five days a week* Program impl«nentat1on was studied by means of 
observations of classes and Interviews were conducted with teachers and 
students* Overall, the classes were found to be well ^organized and 
task-oriented, with a generally positive climate* Achievement of 
students was studied through a comparison of their performance In the 
following fall with that of a cohort of comparable students who did not 
attend summer school* Although the main analyses showed no significant 
differences between the summer school and comparison students, supple-^ 
mental analyses revealed a significant Impact on students who had been 
retained In the first grade* 

Since some summer school evaluations show no overall differences 
between summer school participants and nonpartlclpants, eVen though 
teacher observations Indicate dramatic Improvement in some students, a 
17-d1str1ct cooperative In Columbus, Nebraska, utilized a more sophls^ 
ticated evaluation design to examine the Impact of their Title I summer 
program* The study compared Title I students who attended summer 
school to Title I students who did not* The data available for 
comparison Included teacher ratings of each student*s potential to 
benefit from summer school* achievement test scores, and background 
Information on students* The achievement test scores showed few 
differences between the two groups and pointed out that standardized 
tests are usually not sensitive to short-term Intensive instruction* 
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A study of the Impact of Title I migrant suflfmer programs In four 
migrant centers In Nebraska revealed that a full-day program lasting 
for jIx weeks cafi produce achievement gains as large as the regular 
school year program* Analyses of the niwibcr of hours of instruction 
received by shimmer school and regular school year migrant students 
showed thi^t the two groups spent about equal amounts of time on 
Title I tasks* 

Salt Lake City, Utah, has been emphasizing programs to get Title I 
students more Involved In reading* Their Title I summer progrsn was 
developed by the Parent Advisory Council and Involved mailing out 
reading books to third graders In half of the Title I schools* An 
initial meeting with students and their parents explained the program 
and provided the first book* Additional books were then mailed out 
once d week for 11 weeks* The evaluation design included interviews 
with Title I third graders and their parents (Including participants 
and nonpartlcipants In the program) and achievement testing* The test 
scores showed a small positive effect of the program compared to 
national norms, while nor>part1c1pants showed small losses over the 
summer* The interviews showed that the program was very successful In 
Interesting students and parents In reading* 

Due to these differing results, It is not clear just what effect 
summer school progr^s tend to have* At best, their effects are moderate* 
But It Is clear that under some circumstances gains can be achieved 
over the summer months* Exactly what set of circumstances produce 
g^ins is still to be determined. 

Sustained Effects 

The 1978 Education Amendfiients introduced a new evaluation requirement 
for ESEA Title I: a third testing point to determine whether achievement 
gains observed at the end of Title I program participation were sustained 
for a longer period* The requirement was considered necessary because 
many students were showing large Increases when their achievement was 
assessed using a fall-spring cycle but were not maintaining similar gains 
when they were tested several months after the Title I program had ended* 
Sustained effects are important to consider In this report because: 
(I) this is the first year of the reoulrenient, (2) the requirement 
has been retained In Chapter 1, and (3) many SEAs and LEAs have reacted 
positively to the requirement, as a way to assess the true, long-term 
effects of their progrons* 

tn part because the sustained effects evaluation is not required to 
b<j sent to ED or the SEA, maoy SEAs Initially took the requirement 
lightlyc However, most SEAs did incorporate the sustained effects 
requirement Into their LEA Title I application requirements and made a 
concerted effort to communicate the Implications of the requirements 
to the LEAs* Virginia, for Instance, has conducted regional workshops, 
and has required that the sustained effects evaluation plans be reviewed 
by the SEA and be on file at the SEA* A few SEAs have not provided 
technical assistance, but have required that the LEAs sign assurances 
that a sustained effects evaluation Is being undertaken* 
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In their attempts to implement the new sustained effects requirement, 
SEAS and LEAs have utilized the evaluation chapter of the Tit'e I 
Policy Manual, which details various options for assessing sustained 
effects. In addition, the TACs developed a pack^^t containing answers 
to questions questions often asked about sustained effects, and showing 
seven additional ways to Implement the requirement. Further* a TAC 
workshop designed around the packet Includes a sound/slide presentation, 
transparencies depicting options, and evalutlon planning aids. 

Development of these support materials was necessary because the 
sustained effects requirement is substantially different from the 
standard Title I pre/post evaluation requirement. This latter type of 
evaluation i^ designed to permit aggregation of evaluation data at the 
national and State levels, and thus all SEAs and LEAs must implement a 
number of requirements in the same fashion. On the other hand, the 
sustained effects evaluation is Intended for local use, and hence LEAs 
have wid'^ latitude in meeting the requirement* Within certain practical 
and tecttica^. constraints, LEAs can tailor their sustained effects 
evaluations to answer particular questions they may have about the 
effects of local Title I instructional strategies* staffing configuration, 
or grades served, among others. Thus, while the sustained effects 
requirement is much less restrictive for LEAs (and SEAs), at the same 
time it has required relatively greater planning on the part of LEAs 
I. design appropriate methods to answer particular questions that may 
be pertinent at the local level. 

Overall, LEAs* reaction to the sustained effects requirefnent is most 
encouraging. At first, most LEAs were hesitant to implement additional 
evaluation activities. Further, the flexibility of the sustained 
effects requirement was troublesome: LEAs had become comfortable with 
"being told what to do" in implementing their Title I evaluations. However, 
after LEA personnel became convinced that t^ sustained effects 
evaluation was irtended to permit answers to questions of interest to 
the local personnel, they became very intent on asking '^the right 
question," and obtaining quality information in a timely fashion. In 
fact, LEA personnel have more frequently expressed concerns about the 
quality of the sustained effects evaluation data than about the pre/post 
evaluation data. 

A particularly Interesting finding from a sustained effects 
evaluation was developed in Uoonsocket* Rhode Island* where the LEA 
conducted a longitudinal evaluation of their remedial reading program. 
The LEA found that Title I not only helped students during the year of 
participation, but for as long as three years after they left the 
program. Further* In part because of their sustained effects activities, 
Moonsocket is one of many LEAs which is beginning to exhibit an attitude 
of ownership concerning the overall evaluation process. As this develop- 
mwt suggests, the sustained effects requirement is having an iir^rtant 
effect on how many LEAs think about their evaluations. 

Ritchie County, West Virginia* had been using a county-wide 
assessment test administered In March as its only means for selecting 
Title I participants for the following year. Those students already 
in Title I who scored above the 40th percentile on this test were 
graduated out at the end of the year. However, teachers rated some 
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Title I students who had scored above this cut-off as still needing 
Title I services* A sustained effects study showed that the students 
who were identified as needing further services had lower sustained 
gains than did the other ^graduates*" The results of the study thus 
supported a revised student selection policy which systematically 
Incorporated teacher ratings* 

In Franklin County, Virginia, the sustained effects study provided 
information on which to base a decision regarding whether or not to 
continue providing Title I In grade 6* Students receiving Title I in 
grade 6 continued to show an Increase In their NCE scores, demonstrating 
the effectiveness of the grade 6 program* For this reason, the LEA 
decided to continue LEA Instruction for these children* 

The Clark County School District In Nevada conducted a study to 
determine if reading and mathematics achievement gains made during the 
school year were sustained over a longer period of time* The fall 
1979 pretest scores were compared with the fall 1980 and spring 1981 
scores* It wa?; found that gains In mathematics and reading were 
sustained over the subsequent school year* 

Powers (1979) compared Title I student gains on a falUto-spring and 
fall-to^fall testing schedule In a large school district in Arizona* 
Seventh and ninth grade Title I students were tested, and neither 
of the groups showed absolute losses in achievement on the California 
Test of Basic Skills* In relative terms (compared to national norms), 
the ninth grade group showed a decline over the svnimer* The seventh 
grade group, however, showed a slight Increase over the summer* 

Hawaii conducted sustained effects studies looking at fall, spring, 
and fall test scores for students who continued In Title I programs* 
Data were reported separately for students who attended and who did not 
attend summer school* The pattern of results was consistent across 
districts, with students showing lower gains on fall-to-fall measure- 
ments than on fall-to-spring measurements* In one of the two districts 
with summer programs the students did not show this pattern; In the 
other, the effect was less than for the students who did not attend 
sumer schoo]* 



Summary 

Nearly eight years have passed since the Education Amendments of 1974 
were enacted. In which Section 151 provided new and relatively stringent 
evaluation requirements and defined a far greater accountability for 
Title I programs than had previously existed* We hope that we have 
documented^ fully and fairly, what has transpired during those eight 
years — both In terms of developing. Implementing and apolying the 
results of those evaluations and in terms of using those results nationally 
to examine the effectiveness of the Title I program* 

SEAs and LEAs are now at an Important j'jjicture as they consider how 
their compensatory educational programs will change as Chapter 1 comes 
into effect. To the extent that these decisions are based on what they 
have learned by systematically examining the operations and effects of 
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their Title I programs* then the 1974 objectives Inherent In passing 
Section 151 will have been achieved* To the extent that SEAs and LEAs 
continue to apply the evaluation principles they have learned through 
Implementing their Title I evaluations* Chapter 1 programs will benefit * 
not only In terms of the quality of those programs* but In terms of 
having ready Information concerning the effects of Chapter 1 that are 
certain to be asked for In subsequent legislative and oversight sessions 
of Congress* 
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